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Abstract 



Combinatorial optimization is widely applied in a number of areas nowa- 
days. Unfortunately, many combinatorial optimization problems are NP- 
hard which usually means that they are unsolvable in practice. However, 
it is often unnecessary to have an exact solution. In this case one may use 
heuristic approach to obtain a near-optimal solution in some reasonable time. 

We focus on two combinatorial optimization problems, namely the Gen- 
eralized Traveling Salesman Problem and the Multidimensional Assignment 
Problem. The first problem is an important generalization of the Travel- 
ing Salesman Problem; the second one is a generalization of the Assignment 
Problem for an arbitrary number of dimensions. Both problems are NP-hard 
and have hosts of applications. 

In this work, we discuss different aspects of heuristics design and evalua- 
tion. A broad spectrum of related subjects, covered in this research, includes 
test bed generation and analysis, implementation and performance issues, lo- 
cal search neighborhoods and efficient exploration algorithms, metaheuristics 
design and population sizing in memetic algorithm. 

The most important results are obtained in the areas of local search and 
memetic algorithms for the considered problems. In both cases we have signif- 
icantly advanced the existing knowledge on the local search neighborhoods 
and algorithms by systematizing and improving the previous results. We 
have proposed a number of efficient heuristics which dominate the existing 
algorithms in a wide range of time/quality requirements. 

Several new approaches, introduced in our memetic algorithms, make 
them the state-of-the-art metaheuristics for the corresponding problems. 
Population sizing is one of the most promising among these approaches; it is 
expected to be applicable to virtually any memetic algorithm. 
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Chapter 1 
Introduction 



Nowadays combinatorial optimization problems arise in many circumstances, 
and we need to be able to solve these problems efficiently. Unfortunately, 
many of these problems are proven to be NP-hard, i.e., it is often impossible 
to solve the instances in any reasonable time. 

However, in practice one usually does not need an exact solution of the 
problem. In this case one can use a heuristic algorithm which yields a near- 
optimal solution in a satisfactory time. Some of the heuristics, so-called 
approximation algorithms, guarantee certain solution quality and the poly- 
nomial running time. Unfortunately, this nice theoretical property is usually 
achieved at the cost of relatively poor performance. In other words, a simple 
heuristic is often faster and yields better solutions than an approximation 
algorithm, though a simple heuristic does not guarantee any quality and in 
certain cases it yields very bad solutions. 

In this research we focus on heuristic algorithms which usually have no 
guaranteed solution quality. We are interested in design and selection of 
the most efficient algorithms for real- world use and, thus, we pay a lot of 
attention to experimental evaluation. 

As a case study we consider two combinatorial optimization problems: the 
Generalized Traveling Salesman Problem (GTSP) and the Multidimensional 
Assignment Problem (MAP). Both problems are known to be NP-hard and 
each has a host of applications. 

Though both GTSP and MAP are very important, the researchers did not 
pay enough attention to certain areas around these problems. In particular. 
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the literature lacks any thorough surveys of GTSP or MAP local search; 
there are just a few metaheuristics for MAP and all of them are designed for 
only one special case of the problem; there exists no standard test bed for 
MAP which would include a wide range of instances of different sizes and 
types. This work fills many of these and some other gaps, and, moreover, 
some of the ideas proposed here can be applied to many other optimization 
problems. 

We start from a thorough explanation of the case study problems, their 
applications and existing solution methods. 

Chapter |2] is devoted to some approaches in heuristic design. It discusses 
test bed construction, shows several examples on how theoretical tools can 
help in design of practically efficient heuristics and provides a set of advices 
on high-performance implementation of an algorithm. 

Chapter |3] introduces a classification of GTSP neighborhoods, proposes 
several new ones and includes a number of algorithms and improvements 
which significantly speed up exploration of these neighborhoods both theo- 
retically and practically. Special attention is paid to adaptation for GTSP of 
the well-known Lin-Kernighan heuristic, originally designed for the Traveling 
Salesman Problem. 

Chapter |4[ similar to Chapter [3| considers the MAP neighborhoods and 
local search algorithms. It splits all the MAP neighborhoods into two classes, 
generalizes the existing approaches, proposes some new ones and, finally, 
considers a combined local search which explores neighborhoods of both types 
together. An extensive experimental analysis is intended to select the most 
successful heuristics. 

Chapter [5] is devoted to the so-called Memetic Algorithms (MA). MA 
is a kind of evolutionary algorithms which applies an improvement proce- 
dure to every candidate solution. Several evolutionary algorithms for GTSP, 
including MAs, are already presented in the literature. We propose a new 
MA which features a powerful local search and an efficient termination cri- 
terion. It also uses some other improvements like variation of the population 
size according to the instance size. In our experiments, this algorithm clearly 
outperforms all GTSP metaheuristics known from the literature with respect 
to both solution quality and running time. 
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We develop the idea of adaptive population size and apply it to MAP. In 
our new MA, we use a time based termination criterion, i.e., the algorithm 
is given some certain time to proceed. The population size is selected to 
exploit the given time with maximum efficiency. The experimental results 
provided in Chapter [5] show that the designed algorithm is extremely flexible 
in solution quality/running time trade-off. In other words, it works efficiently 
for a wide range of given times. 

Most of the experimental results are presented in detailed tables and 
placed in Appendix [A} 

We have already published many results provided here. Some aspects 
of heuristic design are discussed in [371 ESI SOl |62] . The test bed for MAP 
was developed in [601 ■ The Lin-Kernighan heuristic is adapted for GTSP 
in [HE] ■ Other GTSP local searches are presented in [SH] • A similar discussion 
of MAP local search can be found in [38] and [60] . The memetic algorithm for 
GTSP is proposed in [37] . The population sizing and the memetic algorithm 
for MAP are suggested in [51] and [ET] . 

1.1 Generalized Traveling Salesman Problem 

The Generalized Traveling Salesman Problem (GTSP) is an extension of the 
Traveling Salesman Problem (TSP). In GTSP, we are given a complete graph 
G = (y,E), where V is a. set of n vertices, and every edge x ^ y E E is 
assigned a weight w{x y). We are also given a proper partition of V into 
clusters Ci, C2, . . . , Cm, i-e., Ci nCj = and |J. Ci = V. A feasible solution, 
or a tour, is a cycle visiting exactly one vertex in every cluster. The objective 
is to find the shortest tour. 

There also exists a variation of the problem where the tour is allowed 
to visit a cluster more than once, see, e.g., [2S]- However, this variation 
is equivalent if the weights in the graph G satisfy the triangle inequality 
w{x — 7- y) < w{x z y) for any x,y, z E V. In what follows, we consider 
the problem of finding the shortest cycle which visits exactly one vertex in 
each cluster. 

If the weight matrix is symmetric, i.e., w{x —)■?/) = w{y — )■ x) for any 
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X E V and y E V, the problem is called symmetric. Otherwise it is an 
asymmetric GTSP. 

There are many publications on GTSP (see, e.g., the surveys [221 El]) and 
the problem has many applications in warehouse order picking with multiple 
stock locations, sequencing computer files, postal routing, airport selection 
and routing for courier planes and some others, see, e.g., [211 ESI ITU [78| and 
references there. 

The problem is NP-hard, since the Traveling Salesman Problem (TSP) 
is a special case of GTSP when |Cj| = 1 for each i. GTSP is trickier than 
TSP in the following sense: it is an NP-hard problem to find a minimum 
weight collection of vertex-disjoint cycles such that each cluster has exactly 
one vertex in the collection (and the claim holds even when each cluster has 
just two vertices) [12] • Compare it with the well-known fact that a minimum 
weight collection of vertex-disjoint cycles covering the whole vertex set in a 
weighted complete digraph can be found in polynomial time [32] . 

1.1.1 Additional Notation 

In what follows we use the following notation: 

• s is the maximum cluster size. Obviously [n/m] <s<n — m-|-l. 

• 7 is the minimum cluster size. Obviously 1 < 7 < \n/m\. 

• Cluster{x) is the cluster containing the vertex x. 

• w{xi —)■ 0:2 —)■... —)■ Xk) is the weight of a path xi —)■ 0:2 —)■...—)■ x^, 

i.e., w{xi X2 Xk) = w{xi — )■ X2) + w{x2 — )• X3) -|- . . . -|- 

w{Xk-l Xk). 

• 'U^min(-^ — 7- y) = min w{x ^ y) denotes the minimum weight of an 
edge from a vertex set X to a vertex set Y. If one substitutes a vertex v 
instead of, e.g., X then we assume that X = {v}. Function w^naxi^ 
Y) is defined similarly. 

• Tj denotes the vertex at the ith position in the tour T. We assume that 
T. — T. 
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• Tour T is also considered as a set of its edges, i.e., T = {Ti — t- T2, T2 — )■ 

T3, ... Tm, Tm — )■ Ti}. 

• Turn{T, x, y) denotes a tour obtained from T by replacing the fragment 
Tj+i ... -^Ty with Tj^ Tj;_i . . . T^+i: 

Turn(T, x, y) = Ty ^ Ty^i Ty_2 -> . . . Tj;+i 

— Ty-^-l —7- Tj,+2 —>...—)■ Ta;_i — > T-c . 

Observe that for the symmetric GTSP the Turn{T,x,y) tour can be 
obtained by deleting the edges — )■ T^+i and Ty — )■ T^+i and adding 
the edges — )■ Tj, and T^+i — )■ T^+i: 

Turn{T,x,y) = T\{T,. -> T3.+1, T^^ ^ Tj^+i}U{T,. T^, T,.+i ^ T^^+i} 
and, hence, the weight of the obtained tour is as follows: 

w{ Turn{T, x, y)) = w{T) - wiT^ T^+i) - w(Ty Ty+i) 

+ w{Tx ^ Ty) + w{Tx+i Ty+i) . (1.1) 

1.1.2 Existing Approaches 

Various approaches to GTSP have been studied. There are exact algorithms 
such as branch-and-bound and branch-and-cut algorithms in [25]. While 
exact algorithms are very important, they are unreliable with respect to 
their running time that can easily reach many hours or even days. For 
example, the well-known TSP solver Concorde [5J can easily solve some 
TSP instances with several thousand cities, but it could not solve several 
asymmetric instances with 316 cities within the time limit of 10^ s [25] . 

Several researchers [TTl 173] 179] proposed transformations of GTSP into 
TSP. At the first glance, the idea to transform a little-studied problem 
into a well-known one seems to be natural. However, this approach has a 
very limited application. Indeed, it requires exact solutions of the obtained 
TSP instances because even a near-optimal solution of such TSP may corre- 
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spond to an infeasible GTSP solution. At the same time, the produced TSP 
instances have quite unusual structure which is hard for the existing TSP 
solvers. A more efficient way to solve GTSP exactly is a branch-and-bound 
algorithm designed by Fischetti et al. [25j. This algorithm was able to solve 
instances with up to 89 clusters. Two approximation algorithms were pro- 
posed in the literature, however, both of them are unsuitable for the general 
case of the problem, and the guarantied solution quality is unreasonably low 
for the real-world applications, see [12] and references therein. 

In order to obtain good (but not necessary exact) solutions for larger 
GTSP instances, one should use heuristic approach. Several construction 
heuristics and local searches were discussed in [121 El ED IS21 IM] and some 
others. A number of metaheuristics were proposed in [12l [531 EH EHl |96l llOlj, 

una. 

1.2 Multidimensional Assignment Problem 

The Multidimensional Assignment Problem (MAP), abbreviated s-AP in the 
case of s dimensions and also called (axial) Multi Index Assignment Problem 
(MIAP) [SI ESj, is a well-known optimization problem. It is an extension 
of the Assignment Problem (AP), which is exactly the two dimensional case 
of MAP. While AP can be solved in polynomial time [69], s-AP for every 
s > 3 is NP-hard [28j and inapproximable [ISQ i.e., there exists no k- 
approximation algorithm for any fixed k. 

The most studied case of MAP is the case of three dimensions [H IH [71 
[T^ [221 [IB] though the problem has a host of applications for higher numbers 
of dimensions, e.g., in matching information from several sensors (data as- 
sociation problem), which arises in plane tracking [771 [HI] , computer vision 
[102] and some other applications [ll[El[13], in routing in meshes [8], tracking 
elementary particles [HE], solving systems of polynomial equations [TU], image 
recognition [32|, resource allocation [32], etc. 

For a fixed s > 2, the problem s-AP is stated as follows. Let Xi = X2 = 
... = Xs = {1, 2, . . . , n}; we will consider only vectors that belong to the 

^Burkard et al. show it for a special case of 3-AP and since 3-AP is a special case of 
s-AP the result can be extended to the general MAP. 
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Cartesian product X = Xi x X2 x . . . x Xg. Each vector e G X is assigned a 
non-negative weight w{e). For a vector e G X, the component ej denotes its 
jth coordinate, i.e., ej G Xj. A collection A of t < n vectors , , . . . , A* 
is a (feasible) partial assignment if Aj 7^ Aj holds for each i ^ k and j G 
{1,2,..., s}. The weight of a partial assignment A is = X]!=i 

A partial assignment with n vectors is called assignment. The objective of 
s-AP is to find an assignment of minimal weight. 



A graph formulation of the problem (see Fig. 1.1) is as follows. Having a 
complete s-partite graph G with parts Xi, X2, . . . , X^, where |Xj| = n, find 
a set of n disjoint cliques in G, each of size s, of the minimal total weight 
with every clique Q in G assigned a weight w{Q) (note that in the general 
case w{Q) is not simply a function of the edges of Q). 




Xi X2 X3 

Figure 1.1: An example of an assignment for a MAP with s = 3 and n = A. This 
assignment contains the following vectors: (1, 3, 4), (2, 1, 1), (3, 2, 3) and (4, 4, 2). Note 
that to simplify the picture we show only a subset of edges for every clique. 



We also provide a permutation form of the assignment which is sometimes 
very convenient. Let tti, 7r2, . . . , vr^ be permutations of Xi, X2, . . . , X^, respec- 
tively. Then niH2 ... vr^ is an assignment of weight ^"^^ w{ni{i)n2{i) ■ ■ ■ TTgi^i)). 
It is obvious that some permutation, say the first one, may be fixed without 
any loss of generality: tti = 1„, where 1„ is the identity permutation of n 
elements. Then the objective of the problem is as follows: 

n 

min w {1712(^1) .. .71 s{i)) 

n2,...,ns '—^ 
1=1 
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and it becomes clear that there exist n\^~^ feasible assignments and the fastest 
known algorithm to find an optimal assignment takes 0{n\^~'^n^) operations. 
Indeed, without loss of generality set tti = 1„ and for every combination of 
7T2, VTs, . . . , Trs_i find the optimal tt^ by solving corresponding AP in 0{n^). 

Thereby, MAP is very hard; it has values in the weight matrix, there 
are ra!'^"^ feasible assignments and the best known algorithm takes 0(r2!*^^n^) 
operations. Compare it, e.g., with the Travelling Salesman Problem which 
has only weights, (n — 1)! possible tours and which can be solved in 
0(^2 ■ 2") time 08]. 

Finally, an integer programming formulation of the problem is as follows. 

min ^ w{ii. . .is) ■ Xij^,„i, 
neXi,...,iseXs 

subject to 

Xii...i, = 1 Wii e Xi, 




h€Xi,...,is-i&Xs-i 

where G {0, 1} for all ii, . . . , is and |Xi| = . . . = \Xs\ = n. 

The problem described above is called balanced [IS]. Sometimes MAP is 
formulated in a more general way if |Xi| = rii, IX2I = ^2, . . . , \Xs\ = Ug and 
the requirement ni = ^2 = . . . = is omitted. However, this case can be 
easily transformed into the balanced problem by complementing the weight 
matrix to an n x n x . . . x n matrix with zeros, where n = maxj n^. 

In what follows we assume that the number of dimensions s is a small 
fixed constant while the size n can be arbitrary large. This corresponds to 
the real applications (see above) and also follows from the previous research, 
see, e.g., [lOl [Ml |93] . 



1.2.1 Existing Approaches 

MAP was studied by many researchers. Several special cases of the prob- 
lem were intensively studied in the literature (see [70] and references there) 
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but only for a few classes of them polynomial time exact algorithms were 
found, see, e.g., [HI HSl |5l]. In many cases MAP remains hard to solve 
fT5[ Uni EHl EZl- For example, if there are three sets of points of size n on a 
Euclidean plane and the objective is to find n triples, every triple has a point 
in each set, such that the total circumference or area of the corresponding 
triangles is minimal, the corresponding 3-APs are still NP-hard [97J. Apart 
from proving NP-hardness, researchers studied asymptotic properties of some 
special instance families [32] . 

As regards the solution methods, there exist several exact and approx- 
imation algorithms [3 HSl [701 iB51 EH] and a number of heuristics including 
construction heuristics [TJ |35l [81], greedy randomized adaptive search pro- 
cedures [H [77] EH [93] (including several concurrent implementations, see, 
e.g., [D [SI]) and a host of local search procedures [I1[71IE1[I51[IS1[S21ISI1[S3]- 

Two metaheuristics were proposed for MAP in the literature, namely a 
simulated annealing procedure [16j and a memetic algorithm [52]. 
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Chapter 2 

Some Aspects of Heuristics 
Design 



Heuristic design still mostly depends on the researcher's skills; there are just 
a few tools to support the scientist in this process. In this chapter we show 
several examples of how such tools can help in heuristic design. 

If a heuristic provides no solution quality or running time guarantee, 
the only choice to evaluate it is to use empirical analysis. One of the most 
important aspects of computational experiment design is test bed selection. 



In Section [271] we discuss MAP test bed design. 

It turns out that there exist no standard test bed for MAP which would 

we 



cover at least the most natural cases of the problem. In Section 2.1 
gather all the instance classes proposed in the literature and systematize 
them. We also split all the instances into two classes according to some 
important properties. This helps in further experimental analysis. 

Unfortunately, there is no way to find the optimal solutions for the in- 
stances of the MAP test bed even of a moderate size in any reasonable time. 
However, in certain circumstances, it is possible to estimate the optimal so- 



lution values. In Section 2.2 we show an example of such estimation for one 



of the most widely used MAP instances family. 



In Section |2.3| we show a successful example of producing a test bed for 
GTSP from a well-known TSP test bed. 

Then we show two examples of improvement of heuristic performance. 
Observe that even a small reduction of the problem size can noticeably speed 
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up a powerful solver. In Section 2.4 we propose two algorithms intended to 
reduce the size of a GTSP instance. Our experiments show that this prepro- 
cessing may successfully reduce the running time of many GTSP algorithms 
known from the literature. 

Another way to improve heuristic performance is to optimize the algo- 
rithm with respect to the hardware architecture. In particular, an extremely 
important aspect is how the algorithm uses the main memory. Indeed, com- 
puter memory is a complicated subsystem and its performance significantly 
depends on the way it is used. It appears that one has to follow just a few 
simple rules in order to improve virtually any algorithm to make it 'friendly' 



with respect to computer memory. In Section 2^ we use three existing and 
one new construction heuristics for MAP as an example and show how these 
algorithms can be improved. 

We also discuss the questions of selecting the most convenient and efficient 



data structures on the example of GTSP in Section 2.6 



2.1 MAP Test Bed 

The question of selecting proper test bed is one of the most important ques- 
tions in heuristic experimental evaluation [89]. While many researchers of 
MAP focused on instances with random independent weights ([H |7l EHl EH] 
and some others) or random instances with predefined solutions [121 123] , sev- 
eral more sophisticated models are of greater practical interest [H [151 CHI 1211 
170] . There is also a number of papers which consider real- world and pseudo 
real-world instances [TUl [771 [SI] but we suppose that these instances do not 
well represent all the instance classes and building a proper benchmark with 
the real-world instances is a subject for another research. 

In this work, we propose splitting all the instance families into two classes: 



instances with independent weights (Section 2.1.1) and instances with de 



composable weights (Section 2.1.2). Later we will show that the heuristics 
perform differently on the instances of these classes and, thus, this division 
is very important for experimental analysis. 
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2.1.1 Instances With Independent Weights 

One of the most studied classes of instances for MAP is Random Instance 
Family. In Random, the weight assigned to a vector is a random integer value 
uniformly distributed in the interval [a,b — 1]. Random instances were used 
in [H m [71 [86] and some others. Later, in Section 2.2 , we will show that it 
is possible to estimate the optimal solution value of a large enough Random 
instance. 

Another class of instances with almost independent weights is GP In- 
stance Family which contains pseudo-random instances with predefined op- 
timal solutions. GP instances are generated by an algorithm produced by 
Grundel and Pardalos [33]. The generator is naturally designed for s-AP 
for arbitrary large values of s and n. However, the generating algorithm is 
exponential and, thus, it was impossible to generate any GP instances even 
of a moderate size. Nevertheless, this is what we need since finally we have 
both small (GP) and large (Random) instances with independent weights with 
known optimal solutions. 



2.1.2 Instances With Decomposable Weights 

In many cases it is not easy to define a weight for an s-tuple of objects but 
it is possible to define a relation between every pair of objects from different 
sets. In this case one should use decomposable weights [HB]- Then the weight 
of a vector e is defined as follows: 

He) = f{dl[l,,dlf^,.^,...,dZ_\:J , (2.1) 

where d^'^ is a weight matrix for the sets Xj and Xj and / is some function. 

The most straightforward instance family with decomposable weights is 
Clique. It defines the function / as the sum of all the arguments: 

n— 1 n 

^^(^) = E E ^Ke. • (2-2) 
1=1 j=i+l 

The Clique instance family was investigated in [HI [IHl [2Z] and some others. It 
was proven [T9] that MAP restricted to Clique instances remains NP-hard. 
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A special case of Clique is Geometric Instance Family. In Geometric, each of 
the sets Xi, X2, ■ . . , Xg corresponds to a set of points in Euclidean space, and 
the distance between two points u & Xi and v G Xj is defined as Euclidean 
distance; we consider the two dimensional Euclidean space: 



It is proven pZj that the Geometric instances are NP-hard to solve for s = 3 
and, thus. Geometric is NP-hard for every s > 3. 

We propose a new instance family with decomposable weights, SquareRoot. 
It is a modification of the Clique instance family. Assume we have s radars 
and n planes and each radar observes all the planes. The problem is to 
assign signals which come from different radars to each other. It is quite 
natural to define some distance function between each pair of signals from 
different radars which would correspond to the similarity of these signals. 
Then for a set of signals which correspond to one plane the sum of these 



distances is expected be small and, hence, (2.2) is a good choice. However, it 
is not actually correct to minimize the total distance between the signals; one 
should also ensure that none of these distances is too large. Note that the 
same requirement appears in a number of other applications. We propose a 
weight function which aims to both small total distance between the assigned 
signals and small dispersion of these distances: 

Wsq(e) 



n— 1 n 

(2-3) 

1=1 j=i+l 



Similar approach is used in [7D] though they do not use square root, i.e., a 
vector weight is just a sum of squares of the edge weights in a clique. In 
addition, the edge weights in [70] are calculated as distances between some 
nodes in a Euclidean space. 

Another special case of the decomposable weights. Product, is studied 
in [I5]. Burkard et al. consider 3-AP and define the weight w{e) as w{e) = 
^ei ' '^62 ■ '^63; where a^, and are random vectors of positive numbers. We 

s 

generalize the Product instance family for s-AP: u^p(e) = JJ^c^e- It is easy to 

j=i 
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show that the Product weight function can be represented in the form (2.1). 
Note that the minimization problem for the Product instances is proven to be 
NP-hard in case s = 3 and, thus, it is NP-hard for every s > 3. 

2.1.3 Additional Details 

We include the following instances in our test bed: 

• Random instances where each weight was randomly chosen in {1, 2, ... , 100}, 



i.e., a = 1 and b = 101. We will show in Section [2. 1.1| that the weights 
of the optimal solutions of all the considered Random instances are very 
likely to be an = n. 

• GP instances with predefined optimal solutions. 

• Clique and SquareRoot instances, where the weight of each edge in the 
graph was randomly selected from {1,2,..., 100}. Instead of the opti- 
mal solution value we use the best known solution value. 

• Geometric instances, where both coordinates of every point were ran- 
domly selected from {1, 2, ... , 100}. The distances between the points 
are calculated precisely while the weight of a vector is rounded to the 
nearest integer. Instead of an optimal solution value we use the best 
known solution value. 

• Product instances, where every value was randomly selected from 
{1,2,. ..,10}. Instead of an optimal solution value we use the best 
known solution value. 

An instance name consists of three parts: the number s of dimensions, 
the type of the instance ('gp' for GP, 'r' for Random, 'cq' for Clique, 'g' for Ge- 
ometric, 'p' for Product and 'sr' for SquareRoot), and the size n of the instance. 
For example, 5r40 means a five dimensional Random instance of size 40. For 
every combination of instance size and type we generated 10 instances, using 
the number seed = s + n + i as a seed of the random number sequences, where 
i is an index of the instance of this type and size, z G {1, 2, . . . , 10}. Thereby, 
every experiment is conducted for 10 different instances of some fixed type 
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and size, i.e., every number reported in the tables below is an average for 10 
runs, one for each of the 10 instances. This smooths out the experimental 
results. 



2.2 Probabilistic Analysis of Test Beds 

In experimental analysis of heuristics, it is important to know the optimal 
solutions for test bed instances. However, it is not always possible to solve 
every instance to optimality. Indeed, heuristic approach is usually applied 
when exact algorithms fail to solve the problem in any reasonable time. 

If the optimal solution cannot be obtained for an instance, one can use a 
lower or an upper bound instead or apply probabilistic analysis of the instance 
if it is generated randomly. In this section we apply the latter approach to 
the MAP Random instance family. 

Recall that in Random instances, the weight assigned to a vector is an 
independent random uniformly distributed integer in the interval [a,b — 1]. 
Let us estimate the average solution value for Random. In fact, we prove that 
it is very likely that every large enough Random instance has an assignment 
of weight an, i.e., a minimal possible assignment (observe that a minimal 
assignment includes n vectors of weight a). 

Let a be the number of assignments of weight na and let c = 6 — a. We 
would like to have an upper bound on the probability Pr(a; = 0). Such an 
upper bound is given in the following theorem whose proof is based on the 
Extended Jansen Inequality given in Theorem 8.1.2 of [2]. 

Theorem 1 For values of n such that n > 3 and 

n — 1\ 1 , , 

>c-2^, (2.4) 



we have Pr(a = 0) < e , where cr = ^ 



[„.(„-l)...(n-fc+l)] = -^ • 

Proof. Let [n] = {1,2, . . . ,n}. Let t be the number of all feasible assign- 
ments and let A be an arbitrary assignment consisting of vectors e\ e^, . . . , e" 
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such that e\ = i for each z G [n]. There are n\ possibilities to choose the jth 
coordinate of all vectors in A for each j = 2, 3, . . . , n and, thus, t = (n!)*~^. 

Let R be the set of vectors in X of weight a and let {Ai, ^2, . . . , At} be 
the set of all assignments. Let Bi be the event {Ai C R} for each i G [t\. 
Let /i = X]i=i Pr(-Si) ^iid A = Pr(_B.j n where i ^ j if i ^ j and 
y4j n y4j 7^ and the sum for A is taken over all ordered pairs {Bi, Bj) with 

By the Extended Jansen Inequality, 

Pr(a = 0) < (2.5) 



provided A > fi. We will compute fi and estimate A to apply (2.5) and to 
show A > fi. It is easy to see that /i = Jr. 

Now we will estimate A. Let Ai (1 Aj = K , k = \K\ and i ^ j- Thus, we 
have 

PiiB.nB,) = Pt{K c RyPTiA,\K c RyPTiA,\K C i?) = ^ 



Q2n—k ' 



Let {f^, . . . , /") be an assignment with fl = i for every i G [n] and 
consider the following two sets of assignments. Let 

P{k) = {{e\ . . . , e") : Vi G [n] {e\ = i) and Vj G [A;] (e^' = f )} 

and let Q{n — k) = {(e\ e^, . . . , e") : Vz G [n] (e*^ = i) and Vj G — 
fc] (e'^+J' 7^ /'^+^)}. Let /i(n,fc) = \P{k) f] Q{n - k)\. Clearly, /i(n, A;) < 
\P(k)\ = {{n - k)\Y~\ Observe that 



h{n, k) > \P{k)\ -{n- k)\P{k + 1)| = L(n, k, s). 



where -C/(n, fc, s) = ((n — fc)!)^ ^ — (n — fc) ■ ((n — k — 1)!)'* ""^ 

Let (y'(n, fc) be the number of ordered pairs {Ai, Aj) such that lAjflAjl = k. 
Observe that g{n, k) = t- (2) ■ h{n, k) and, thus, ^ ■ ■ L{n, k, s) < g{n, k) < 
t-{l)-{in-k)\y 



, s-1 
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n-2 n-2 

Observe that A = ^ ^ Pr(5i n Bj) = ^ g{n, k) ■ c'^-^". Thus, 

k=l \AinAj\=k k=l 

g (';).c'.L(„.M) < A < <^g Q.cMC-^!)"-' (2.6) 



Now Pr(a = 0) < e 2^ follows from (2.5) by substituting yU with ^ 



and A with its upper bound in ( |2.6 ). It remains to prove that A > /i. Since 



n > 3, L(n, 1, s) > -^{{n — 1)!)* ^. By the lower bound for A in (2.6), we 



have A > '■"'l-i • L(n,l,k). Therefore, — > — . Now using the 



inequality (n— 1)! > (^^)" ^, we conclude that — > 1 provided (2.4) holds. 



□ 

Useful results can also be obtained from (11) in [32] that is an upper 
bound for the average optimal solution. Grundel, Oliveira and Pardalos [32] 
consider the same instance family except the weights of the vectors are real 
numbers uniformly distributed in the interval [a,b]. However the results 
from p2] can be extended to our discrete case. Let w'{e) be a real weight 
of the vector e in a continuous instance. Consider a discrete instance with 
w{e) = [w'{e)\ (if w'{e) = b, set w{e) = 6 — 1). Note that the weight 
w{e) is a uniformly distributed integer in the interval [a, 6 — 1]. The optimal 
assignment weight of this instance is not larger than the optimal assignment 
weight of the continuous instance and, thus, the upper bound for the average 
optimal solution for the discrete case is correct. 

In fact, the upper bound (see [32]) for the average optimal solution 
is not really accurate. For example, ~ an + 6.9 for s = 3, n = 100 and 
b - a = 100, and ^ an + 3.6 for s = 3, n = 200 and 6 - a = 100. It 
gives a better approximation for larger values of s, e.g., 2* ~ an + 1.0 for 
s = 4, n = 40 and b — a = 100, but Theorem [T] provides stronger results 
(Pr(a > 0) ^ 1.000 in the latter case). 

The following table gives the probabilities for Pr(a > 0) for various values 
of s and n: 
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s = 4 




s = 5 


s = 6 


s = 7 


n 


Pr(a > 0) 


n 


Pr(« > 0) 


n Pr(a > 0) 


n Pr(« > 0) 


15 


0.575 


10 


0.991 


8 1.000 


7 1.000 


20 


0.823 


11 


0.998 






25 


0.943 


12 


1.000 






30 


0.986 










35 


0.997 










40 


1.000 











2.3 GTSP Test Bed 



There is a standard test bed which was used in most of the recent hterature 
on GTSP, see, e.g., [951 EHl I101[ 1100] . It is produced from a well-known 
TSP test bed called TSPLIB f9T]. TSPLIB contains both symmetric and 
asymmetric instances of different sizes and types, some pseudo-random and 
some real-world ones. 

The procedure of generating a GTSP instance from a TSP instance was 
proposed by Fischetti, Salazar, and Toth [23]. It is applicable to both sym- 
metric and asymmetric TSP instances and produces symmetric and asym- 
metric GTSP instances, respectively. The number of vertices n in the pro- 
duced GTSP instance is the same as in the original TSP instance; the number 
m of clusters is m = [^/5]. The clusters are 'localized', i.e., the procedure 
attempts to group close vertices into the same clusters. 

TSPLIB includes instances from as few as 14 to as many as 85900 vertices. 
In our experiments, we usually consider instances with 10 < m < 217. The 
same test bed is used in a number of papers, see, e.g., [121 El EH ES]. In 
other papers the bounds are even smaller. 

Every instance name consists of three parts: 'm t n\ where m is the 
number of clusters, t is the type of the original TSP instance (see [91] for 
details) and n is the number of vertices. 

Observe that the optimal solutions are known only for certain instances 
with up to 89 clusters [25]. For the rest of the test bed we use the best known 
solutions obtained in our experiments and from the literature [121 195] . 
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2.4 Preprocessing 

Preprocessing is a procedure of an instance simplification. It is used to 
reduce the computation time of a solver. There are several examples of such 
approaches in integer and linear programming (e.g., [HI [HI]) as well as for the 
Vehicle Routing Problem [72] . In some cases preprocessing plays the key role 
in an algorithm (see, e.g., [26]). Next we propose two efficient preprocessing 
procedures for GTSP. 

2.4.1 GTSP Reduction Algorithms 

An important feature of GTSP is that a feasible tour does not visit every ver- 
tex of the problem and, thus, GTSP may contain vertices that a priori cannot 
be included in the optimal tour and, hence, may be removed in advance. 

Definition 1 Let C be a cluster, \C\ > 1. We say that a vertex r & C is 
redundant if, for each pair x and y of vertices from distinct clusters different 
from C, there exists r' E C \ {r} such that w{x r' ^ y) < w{x r ^ y). 

Testing this condition for every vertex takes approximately 0{n^s) oper- 
ations. In some cases it is possible to significantly reduce the preprocessing 
time for symmetric instances. 

Let us fix some vertex r G C. For every r' E C and every x ^ C 
calculate the value AJJ/'"' = w{x — )■ r) ~w{x — r'). Observe that a vertex r is 
redundant if there is no pair of vertices x,y ^ C from different clusters such 
that A7 + A-"/ < for every r', i.e., r is redundant if for every x,y ^ C, 
Cluster{x) ^ Cluster{y), there exists r' G C\{r} such that A^' + A^'*"' > 0. 
That is due to A^'^'' + A^'^' = w{x — > r) — w{x — )■ r') + w{y —^r)— w{y — )■ 
r') = w{x r ^ y) — w{x — r' — > y). 

There is a way to accelerate the algorithm. If 

min max A^f + min max AY < 
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for some cluster Z, then we know immediately that r cannot be reduced. We 
can use an equivalent condition: 

min max /Vf + min max A!.''' < 

This condition can be tested during the A values calculation by accumulating 
the value of min max /Vf . 

Removing a redundant vertex may cause a previously irredundant vertex 
to become redundant. Thus, it is useful to check redundancy of vertices in 
cyclic order until we see that, in the last cycle, no vertices are found to be 
redundant. However, in the worst case, that would lead to the total number 
of the redundancy tests to be ©(n^). Our computational experience has 
shown that almost all redundant vertices are found in two cycles. Hence, we 
never conduct the redundancy test more than twice for a vertex. 

Similar to the vertices, it is sometimes possible to say in advance that a 
certain edge cannot be included in the optimal tour. 

Definition 2 Let u and v he a pair of vertices from distinct clusters U and 
C respectively. Then the edge u ^ v is redundant if for each vertex x &V\ 
{U UC) there exists v' & C \ {v} such that w{u v' ^ x) < w{u — > v — >■ x). 

We propose the following algorithm for the edge reduction. Given a vertex 
V G C, \C\ > 1, we detect redundant edges incident with v using the following 
procedure: 

1. Select an arbitrary vertex v" e C \ {v}. 

2. Set = /y/' for each vertex xeV\C. 

3. Sort the array P in non-decreasing order. 

4. For each cluster U ^ C and for each vertex m e t/ do the following: 

(a) 5 = Ar". 

(b) For each item A^''"" of the array P such that A^'"" + 5 < check: 
lix^U and 1^/ + A^^'''' < for every v' e C \ {v, v"}, the edge 
u ^ V is immediately not redundant, continue with the next u. 
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(c) Edge u V is redundant, set w{u v) = oo. 

To prove that the above edge reduction algorithm works correctly, let us 
fix some edge u ^ v, u & U, v & C, U C. The algorithm declares this 



edge redundant if the following condition holds for each x ^ C (see 4b): 



Al'^" + Al'''" > or 

A^'"' + A7' > for some v' E C \ {v, v"} . 

This is equivalent to 

A^'"' + a::-''' > for some v' eC\{v}. 

So the algorithm declares the edge u v redundant if for each x G 
V\C\U there exists v' E C \ {v} such that A^'^' + A^''^' > 0: 

w{x — )■ f ) — w{x, v') + w{u — > f ) — w{u — )■ f ') > and, hence. 



The edge reduction procedure is executed exactly once for every vertex v 
such that \ Cluster{v)\ > 1. The whole algorithm takes 0{n^s) operations. 

2.4.2 GTSP Reduction Experimental Evaluation 

We have tested three reduction algorithms: the Vertex Reduction Algorithm, 
the Edge Reduction Algorithm, and the Combined Algorithm which first 
applies the Vertex Reduction and then the Edge Reduction. 
The columns of Table IA.5I are as follows: 

• Instance is the instance name. Note that the suffix number in the name 
is the number of vertices before any preprocessing. 

• Ry is the number of vertices detected as redundant. 

• Re is the number of edges detected as redundant. For the Combined 
Algorithm, Re shows the number of redundant edges in the instances 
already reduced by the Vertex Reduction. 
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• T is preprocessing time, in seconds. 

All the algorithms are implemented in C++; the evaluation platform is 
based on an AMD Athlon 64 X2 Core Dual processor (3 GHz frequency). 



The results of the experiments (Table |A3 ) show that the preprocessing 
time for the Vertex Reduction is negligible (less than 50 ms) for all the 
instances up to 212ul060, i.e., for almost all TSPLIB-based GTSP instances 
used in the literature. The average percentage of detected redundant vertices 
for these instances is 14%, and it is 11% for all considered instances. The 
experimental complexity of the Vertex Reduction algorithm is about 0(n^-^). 

The Edge Reduction is more time-consuming than the Vertex Reduction. 
The running time is negligible for all instances up to 115rat575. Note that 
in most of the GTSP literature, only instances with m < 89 are considered. 
The average per cent of the detected redundant edges for these instances is 



about 27%, and it is 21% for all the instances in Table A.5[ The experimental 
complexity of the Edge Reduction algorithm is 0(n^'^). 



2.4.3 Influence of GTSP Reduction on Solvers 

Certainly, one can doubt the usefulness of our reduction algorithms since they 
may not necessarily decrease the running time of GTSP solvers. Therefore, 
we have experimentally checked if the reductions are beneficial for several 
powerful GTSP solvers (obviously, preprocessing is useless in combination 
with a fast solver since preprocessing may take more time than the solver 
itself): 

• An exact algorithm (Exact) based on a transformation of GTSP to 
TSP [11]; the algorithm from [23] was not available. The algorithm 
that we use converts a GTSP instance with n vertices to a TSP instance 
with 3n vertices in the polynomial time, solves the obtained TSP using 
the Concorde solver [5j, and then converts the obtained TSP solution 
to GTSP solution also in the polynomial time. 

• A memetic algorithm from [96] (SD). 

• A memetic algorithm from (SG). 
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A modified version of our memetic algoritlim (see Section 5.1) (GK). 



For eacli stocliastic algoritlim, every test was repeated ten times and an 
average was used. The columns of the tables not described above are as 
follows: 

• To is the original solution time. 

T — T 

• B is the time benefit, i.e., — — — — ■ 100%, where Tpr is the solution 

Tq 

time after preprocessed; this includes the preprocessing time. 



The experiments (see Tables A.l , A. 2, A. 3 and A. 4) show that the Vertex 



Reduction, the Edge Reduction and the Combined Reduction Techniques sig- 
nificantly reduce the running time of the Exact and SD solvers. However, the 
Edge Reduction (and because of that the Combined Reduction Technique) is 



not that successful for SG (Table A. 3) and the original version of GK. That 



is because not every algorithm processes infinite or enormous edges well. 

We have adjusted our solver GK to work better with preprocessed in- 
stances. The details of the modified version can be found in Section 15.1.101 
The modified algorithm does not reproduce exactly the results of the origi- 
nal GK heuristic; it produces slightly better solutions at the cost of slightly 



larger running times. However, one can see (Table A. 4) that all the Reduc- 
tion Algorithms proposed in this section influence the modified GK algorithm 
positively. 

Different reductions have different degree of success for different solvers. 
The Edge Reduction is more efficient than the Vertex Reduction for SD; in 
other cases the Vertex Reduction is more successful. For every solver except 
SG the Combined Technique is preferred to single reductions. 

Preprocessing is called to reduce the solution time. On the other hand, 
there is no guarantee that the outcome of the preprocessing will be noticeable. 
Thus, it is important to ensure that, at least, preprocessing is significantly 
faster than the solver. 

Four GTSP solvers are considered in this section. The first solver. Exact, 
is exponential and, thus, it is clear that its time complexity is larger than the 
one of the reduction algorithms. The time complexities of the other three 
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solvers were estimated experimentally. The experimental complexity of SD 
is about Q{n^) and it is about Q{n^-^) for GK and SG. 

Since the time complexity of every considered solver is higher than the 
time complexity of preprocessing, we can conclude that preprocessing remains 
relatively fast for an arbitrary large instance. 

Note that the solution quality of the considered solvers was not affected 
by the reductions, on average. 

2.4.4 MAP Preprocessing 

Wc do not discuss any preprocessing for MAP. Observe that the Vertex 
Reduction proposed above for GTSP preserves the structure of the problem 
and, hence, any ordinary GTSP solver may be applied to a reduced instance. 
However, it is not the case for the Edge Reduction (see above) since the 
yielded instances may contain infinite edges. 

It is unlikely that a MAP preprocessing can reduce the values of s or n. 
One can rather think of removing certain vectors from the X set, however, 
this would change the problem structure and, hence, complicate the solvers. 

2.5 Implementation Performance Issues 

It may seem that implementation is a technical question which is not worth 
discussion because its influence on the algorithm's performance is negligible 
and, moreover, platform-dependent. In this section we will show that this 
assumption is sometimes very wrong. It turns out that two formally equal 
implementations of some algorithm may have very different running times in 
certain circumstances. In particular, we will show that some simple transfor- 
mations of an algorithm may be crucial with respect to efficiency of processor 
cache usage. Note that this discussion does not involve any specifics of par- 
ticular CPUs and is relevant to all the computers produced in at least last 
30 years. 

For a case study we need some algorithms which deal with large amounts 
of data. For this purpose we selected MAP construction heuristics. Recall 
that MAP instance is defined by an s-dimensional matrix of size n, i.e., it 
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requires values. Construction heuristics are very quick and, hence, we are 
able to consider very large instances such that the weight matrices exceed 
the size of processor cache. 

In Section [2.5. II we describe all MAP construction heuristics known from 



the literature and propose a new one, Shift-ROM. In Section 2.5.2 we dis- 
cuss the efficiency of computer memory in certain circumstances and provide 
several simple rules to improve performance of an algorithm implementa- 



tion. Then, in Section 2.5.3 , we show how these rules can be applied to the 
MAP construction heuristics. We do not provide any experimental analysis 
here; one can refer to [02] for details. We only declare here that the refine- 
ments proposed below speed up each of the considered heuristics in, roughly 
speaking, 2 to 5 times. 

2.5.1 MAP Construction Heuristics 

Greedy 

The Greedy heuristic starts with an empty partial assignment A = 0. On 
each of n iterations Greedy finds a vector e G X of minimum weight, such 
that A U {e} is a feasible partial assignment, and adds it to A. 

The time complexity of Greedy heuristic is 0{n'^ — l)'^ + ...-|-2*-|-l) = 
0(n*^^) (if the Greedy algorithm is implemented via sorting of all the vectors 
according to their weights, the algorithm complexity is 0(n* Tog n'^) however 



this implementation is inefficient, see Section 2.5.3) 



Max-Regret 

The Max-Regret heuristic was first introduced in for 3-AP and its modifi- 
cations for s-AP were considered in [TO] . 

Max-Regret proceeds as follows. Initialize a partial assignment A = 0. 
Set Vd = {1,2, ... ,n} for each 1 < d < s. For each dimension d and each 
coordinate value v E Va consider every vector e G X' such that = v, where 
X' C X is the set of 'available' vectors, i.e., A U {e} is a feasible partial 
assignment if and only if e G X'. Find two vectors e^min and e^min in the 
considered subset Y^^^ = {e G X' : = f } such that e^min = argminti;(e), 
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and e^min = argmin w{e). Select the pair {d,v) that corresponds to the 

^^'^d,v\{^ min} 

maximum difference w(e^min) — ""^(e^min) and add the vector e^mm for the 
selected {d,v) to A. 

The time complexity of Max-Regret is 0{s-n^ + s-{n — iy + . . .+s-2** + s) = 
0(s-n^+i). 

ROM 

The Recursive Opt Matching (ROM) is introduced in [33] as a heuristic of 
large domination number (see ^35j for definitions and results in domination 
analysis). ROM proceeds as follows. Initialize A with a trivial assignment: 
A^ = {i,i, . . . ,i). On each jth iteration of the heuristic, j = 1, 2, . . . , s — 1, 
calculate an n x n matrix Mi^^ = w{e), where Y{j, i,v) is a set of all 

e(^Y {j,i,v) 

vectors e G X such that the first j coordinates of the vector e are equal to 
the first j coordinates of the vector A^ and the (j + l)th coordinate of e is 
v: Y{j,i,v) = {e E X : Ck = A^, I < k < j and e^+i = v}. Let permutation 
TT be a solution of the 2-AP for the matrix M. Set ^j+i = vr(i) for each 
1 < i < n. 

The time complexity of ROM heuristic is 0{{n'^ + n^) + (n*~^ +n^) + . . . + 
(n^ + n^)) = 0(n'' + sn^). 

Shift-ROM 

A disadvantage of the ROM heuristic is that it is not symmetric with respect 
to the dimensions. For example, if the vector weights do not depend signifi- 
cantly on the last coordinate then the algorithm is likely to work badly. Shift- 
ROM is intended to solve this problem by trying ROM for different permuta- 
tions of the instance dimensions. However, we do not wish to try all s\ pos- 
sible dimension permutations as that would increase the running time of the 
algorithm quite significantly. We apply only s permutations: {X1X2 . . . Xg), 
{XsXiX2 . . . Xg^i), (Xs_iXsXiX2 . . . Xs-2), ■ ■ ■ , (-^2-^3 • • • -^s-^i)- 

In other words, on each run Shift-ROM applies ROM to the problem; upon 
completion, it renumbers the dimensions for the next run in the following 
way: Xi ^ X2, X2 i— X3, . . . , Xs_i X^, Xg ^ Xi. After s runs, the 



2.5. Implementation Performance Issues 



38 



best solution is selected. 

The time complexity of Shift-ROM heuristic is 0((n^ + sn^)-s) = 0{sn^ + 

Time Complexity Comparison 

Now we can gather all the information about the time complexity of the 
considered heuristics. The following table shows the time complexity of each 
of the heuristics for different values of s: 





Greedy 


Max-Regret 


ROM 


Shift- ROM 


Arbitrary s 










Fixed s = 3 










Fixed s > 4 






0{n') 


0{n') 



2.5.2 Performance Notes 

In a standard computer model it is assumed that all the operations take 
approximately the same time. However, it is not true since the architecture 
of a modern computer is complex. We will use a more sophisticated model 
in our further discussion. The idea is to differentiate fast and slow memory 
access operations. 

The weight matrix of a MAP instance is normally stored in the Random 
Access Memory (RAM) of a computer. RAM's capacity is large enough even 
for very large instances, e.g., nowadays RAM of an average desktop PC is 
able to hold a weight matrix for 3-AP with n = 750, i.e., 4.2 ■ 10^ weight^ 
RAM is a fast storage; one can load gigabytes of data from RAM in one 
second. However, RAM has a comparatively high latency, i.e., it takes a lot 
of time for the processor to access even a small portion of data in RAM. 
Processor cache is intended to minimize the time spent by the processor for 
waiting for RAM response. 

The processor cache exploits two heuristics: firstly, if some data was re- 
cently used then there is a high probability that it will be used again soon, 

"'^Here and further we assume that every weight is represented with a 4 byte integer. 
The calculations are provided for 2 Gb of RAM. 
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and, secondly, the data is usually used successively, i.e., if some portion of 
data is used now then it is likely that the successive portion of data will 
be used soon. As an example, consider an in place vector multiplication 
algorithm: on every iteration the algorithm loads a value from the mem- 
ory, multiplies it and saves the result at the same memory position. So, the 
algorithm accesses every portion of data twice and the data is accessed suc- 
cessively, i.e., the algorithm accesses the first element of the vector, then it 
accesses the second element, the third one, etc. 

Processor cach^ is a temporary data storage, relatively small and fast, 
usually located on the same chip as the processor. It contains several cache 
lines of the same size; each cache line holds a copy of some fragment of the 
data stored in RAM. Each time the processor needs to access some data in 
RAM it checks whether this data is already presented in the cache. If this 
is the case, it accesses this data in the cache instead. Otherwise that if a 
'miss' is detected, the processor suspends, some cache line is freed and a new 
portion of data is loaded from RAM to cache. Then the processor resumes 
and accesses the data in the cache as normally. Note that in case of a 'miss' 
the system loads the whole cache line that is currently 64 bytes on most of 
the modern computers [3] and this size tends to grow with the development 
of computer architecture. Thus, if a program accesses some value in the 
memory several times in a short period of time it is very likely that this data 
will be loaded from RAM just once and then will be stored in the cache so 
the access time will be minimal. Moreover, if some value is accessed and, 
thus, loaded from RAM to the processor cache, it is likely that the next value 
is also loaded since the cache line is large enough to store several values. 

With respect to MAP heuristics, there are two key rules for improving 
the memory subsystem performance: 

1. The successive access to the weight matrix (scan), i.e., access to the 
matrix in the order of its alignment in the memory, is strongly preferred 
(we use the row-major order [61] for weight matrix in our implementa- 
tions of the algorithms). Note that if an algorithm accesses, e.g., every 
second weight in the matrix and does it in the proper order, the real 
complexity of this scan with respect to the memory subsystem is the 

^We provide a simplified overview of cache; for detailed information, see, e.g., [B]. 
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same as the complexity of a full scan since loading of one value causes 
loading of several neighbor values. 

2. One should minimize the number of the weight matrix scans as much 
as possible. Even a partial matrix scan is likely to access much more 
data than the processor cache is able to store, i.e., the data will be 
loaded from RAM all over again for every scan. 

Following these rules may significantly improve the running time of the 
heuristics. In our experiments, the benefit of following these rules was a 
speed-up of roughly speaking 2 to 5 times. 

2.5.3 MAP Construction Heuristics Improvement 

Greedy Heuristic Optimization 

A common implementation of the greedy approach for a combinatorial opti- 
mization problem involves sorting of all the weights in the problem. In case 
of MAP this approach is inefficient since we actually need only n vectors from 
the set of size n^. Another natural implementation of the Greedy heuristic is 
to scan all available vectors and to choose the hghtest one on each iteration 
but it is very unfriendly with respect to the memory subsystem: it performs 
n scans of the weight matrix. 

We propose a combination of these approaches; our algorithm proceeds 
as follows. Let A — he a, partial assignment and B an array of vectors. 
While 1^1 < n, i.e., A is not a full assignment, the following is repeated. We 
scan the weight matrix to fill the array B with k vectors corresponding to k 
minimal weights in non-decreasing order: if the weight of the current vector 
is less than the largest weight in B then we insert the current vector to B 
in the appropriate position and, if necessary, remove the last element of B. 
Then, for each vector e e B, starting from the lightest, we check whether 
A U {e} is a feasible partial assignment and, if so, add e to A. Note, that 
during the second and further cycles we scan not the whole weight matrix 
but only a subset X' C X oi the vectors that can be included into the partial 
assignment A with the feasibility preservation: 74u{x} is a partial assignment 
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for any x G X'. The size of the array B is calculated as = min{64, 
in our implementation. The constant 64 is obtained empirically. 

The algorithm is especially efficient on the first iterations, i.e., in the 
hardest part of its work, while the most of the vectors are feasible. However, 
there exists a bad case for this heuristic. Assume that the weight matrix 
contains a lot of vectors of the minimal weight Wmm- Then the array B will 
be filled with vectors of the weight Wmin at the beginning of the scan and, 
thus, it will contain a lot of similar vectors (recall that the weight matrix 
is stored in the row-major order and only the last coordinates are varied at 
the beginning of the scan, so all the vectors processed at the beginning of 
the scan are likely to have the same first coordinates). As a result, selecting 
the first of these vectors will cause infeasibility for the other vectors in B. 
We use an additional heuristic to decrease the running time of the Greedy 
algorithm for such instances. Let w^i^ be the minimum possible weight: 
Wmin = miueex' w{e) (sometimes this value is known like for Random instance 



family it is 1, see Section 2.1). If it occurs during the matrix scan that all 
the vectors in B have the weight w^i^i, i-e., w{Bi) = Wmin for every I < i < k, 
then the rest of the scan can be skipped because there is certainly no vector 
lighter than B^. Moreover, it is safe to update Wmin with w{Bk) every time 
before the next matrix scan. 

Max-Regret Heuristic Optimization 

The Max-Regret heuristic naturally requires O(n^s) weight matrix partial 
scans. Each of these scans fixes one coordinate and, thus, every available 



vector e E X' (see Subsection 2.5.3) is accessed s times during each iteration, 
and this access is very inefficient when the last coordinate is fixed (recall 
that the weight matrix is stored in a row-major order and, thus, if the last 
coordinate is fixed then the algorithm accesses every nth value in the memory, 
i.e., the access is very non-successive and one can assume that this scan will 
load the whole weight matrix from RAM to cache). In our more detailed 



computer model (see Section 2.5.2), the time complexity of the non-optimized 
Max-Regret is 0{{s - 1) ■ n"+^ + n'^^). 

We propose another way to implement Max-Regret. Let us scan the whole 
set X' of available vectors on each iteration. Let L be an n x s matrix of 
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the lightest vector pairs: Ljj and Lf j are the lightest vectors when the jth 
coordinate is fixed as i, and w{L}j) < w{Lfj). To fill the matrix L we do 
the following: for every vector e & X' and for every coordinate 1 < d < s 
check: if w{e) < w(Li^ J, set L^^^^ = L^^^^ and L^^^^ = e. Otherwise if 
w{e) < Ll^^^, set -^g^.d ~ ^- Thus, we update the Le^^d item of the matrix 
with the current e if w{e) is small enough. Having the matrix L, we can 
easily find the coordinate d and the fixed value v such that w{Ll^^) — w{Ll^^) 
is maximized. The vector Lj^^ is added to the solution and the next iteration 
of the algorithm is executed. 

The proposed algorithm performs just n partial scans of the weight ma- 
trix. The matrix L is usually small enough to fit in the processor cache, so the 
access to L is fast. Thus, the time complexity of the optimized Max- Regret 
in our more detailed computer model is 0{n^'^^). 

ROM Heuristic Optimization 

The ROM heuristic can be implemented in a very friendly way with respect 
to the memory access. On the first iteration it fixes the first two coordinates 
{n^ combinations) and enumerates all vectors with these fixed coordinates. 
Thus, it scans the whole weight matrix successively. On the next iteration it 
fixes three coordinates (n^ combinations as the second coordinate depends on 
the first one), and enumerates all vectors with these fixed coordinates. Thus, 
it scans solid n*~^-size fragments of the weight matrix; further iterations 
are similar. As a result, the time complexity of ROM in our more detailed 
computer model is the same as in a simple one: 0{n^ + sn^). 

Shift-ROM Heuristic Optimization 

The Shift- ROM heuristic is an extension of ROM; it simply runs ROM s 
times, starting it from different dimensions. However, not every run of ROM 
is efficient when it is a part of Shift-ROM. Let us consider the case when 
the first iteration of ROM fixes the last two coordinates. For each of the 
combinations of the last two coordinate values, the heuristic scans the 
whole weight matrix with the step between the accessed weights, i.e., 
the distance between the successively accessed weights in the memory is 
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elements, which is very inefficient. A similar situation occurs when the first 
and the last dimensions are fixed. 

To avoid this disadvantage, we propose the following algorithm. Let M'^ 
be an n X n matrix for every I < d < s. Initialize M^^ = for every 
1 < d < s and 1 < i,J < n. For each vector e G X and for each 1 < d < s 
set M^^ g^^^ = M^^ + w{e) (here we assume that e^+i = ei). Now the 
matrices M'^ can be used for the first iteration of every ROM run. 

When applying this technique, only one full matrix scan is needed for 
the heuristic and this scan is successive. There are several other inefficient 
iterations like fixing of the last three coordinates but their infiuence on the 
algorithm's performance is negligible. 

2.6 Data Structures 

In some cases data structure plays the key role in an algorithm's theoretical 
efficiency (see, e.g., [55] and references there). In other cases it does not 
change the theoretical time complexity of an algorithm but it is still worth 
a separate discussion. Below we consider several data structures for GTSP 
algorithms. 

2.6.1 GTSP Tour Storage 

It is a non-trivial question how one should store a GTSP solution. The 
most common approach is to store a sequence of vertices in the visiting 
order. It was used in [951 HOP] and many others. The advantages of this 
method are simplicity, compactness (it requires only an integer array of size 
m) and quickness of the weight calculation. The disadvantages are difficulty 
in some tour modifications (observe that moving one vertex requires up to m 
operations) and absence of a trivial way to check the tour correctness. Sliding 
along the tour is easy in this representation but requires some additional 
checks. 

Another tour representation, random- key, was used in [96]. It represents 
the tour as a sequence of real numbers xi, X2, . . . , x^; the ith. number Xi 
corresponds to the ith cluster Cj of the problem. The integer part [xj of 
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the number is the vertex index within the cluster Cj and the fractional part 
Xi — \_Xi\ determines the position of the cluster in the tour — the clusters 
are ordered according to these fractional parts, in ascending order. The 
main advantage of random-key tours is that almost any sequence of numbers 
represent a correct tour; one only needs to ensure that 1 < [xjj < \Ci\ for 
every i. It is also relatively easy to implement some modifications of the 
tour. The disadvantages are difficulty in sliding along the tour and the high 
cost of the tour weight calculation. 

We propose a new tour representation which is base on double-linked 
lists. In particular, we store three integer arrays of size m: prev, next and 
vertices, where prev^ is the cluster preceding the cluster Cj in the tour, nexti 
is the cluster succeeding the cluster Ci in the tour, and verticesi is the vertex 
within cluster Cj. There are several important advantages of this repre- 
sentation. Unlike other approaches, it naturally represents the cycle which 
simplifies the algorithms. Consider, e.g., a typical local search implementa- 
tion (Algorithm [T]) : the algorithm smoothly slides along the tour until no 

Algorithm 1 A typical implementation of a local search based on the double- 
linked list tour representation. In this example the algorithm preforms as few 
iterations as possible to ensure that the tour is a local minimum. 

Set the current cluster X 1. 
Set the counter t m. 
while t > do 

if there exist some improvements for the current cluster X then 

Update the tour accordingly. 

Update the counter t m. 
else 

Decrease the counter t ^ t — 1. 
Move to the next cluster X <r- nextx- 



improvement is found for exactly one loop. Observe that one does not need 
the concept of position when using this tour representation; it is possible 
to use cluster index instead. In this context the procedure of tour rotation 
becomes meaningless; one can simply consider any cluster as the first cluster 
in the tour. Moreover, it allows one to find a certain cluster in 0(1) time; 
we use it, e.g., to start the CO calculations from the smallest cluster with 
no extra effort. Our representation clearly splits the cluster order and the 
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vertex selection; note that some algorithms do not require the information 
on the vertex selection while some others do not modify the cluster order. 
It is useful that linked lists allow quick removing and inserting elements. To 
turn the tour backwards, one only has to swap prev and next. Observe that 
this tour representation is deterministic, i.e., each GTSP tour has exactly 
one representation in this form. If the problem is symmetric, every tour 
{prev, next, vertices) has exactly one clone {next, prev, vertices). 

The main disadvantage of this representation is that it takes three times 
more space than the sequence of vertices. In fact, implementation of many 
algorithms do not require backward links. In this case one can avoid using 
the prev array and hence use only two m-elements arrays. When necessary, 
one can quickly restore the prev array according to next. 

Note that a similar tour representation was used in |1U1] . 

2.6.2 GTSP Weights Storage 

Another important decision is how to store the weights of a GTSP instance. 
There are two obvious solutions of this problem: 

1. Store a two dimensional matrix M of size n x n as follows: Mij = 
w{Vi, — )■ Vj). Note that this data structure stores l^iP redundant 
weights. 

2. Store m{m — 1) matrices, one matrix M^'"^ of size |X| x \Y\ per every 
pair of distinct clusters X and Y. 

If we have a pair of vertices and we need to get the weight between them, 
it is obviously better to use the first approach. However, if we need to use 
many weights between two clusters (consider, e.g., calculation of the smallest 
weight between clusters X and Y: Winin(X — > Y)), the second approach is 
preferable. Indeed, in the first approach we have to use something like Mx^^Yj , 
i.e., look for the absolute index of every vertex in X and Y. In the second 
approach we just find the matrix M"^'^ and then use it like this: Mf'-^ . 
Observe that the second approach provides a sequential access to the weight 
matrix which is very friendly with respect to the computer architecture, see 
Section |23;i 
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Our experimental analysis shows that the second approach improves the 
performance of some algorithms approximately twice. However, it is not 
efficient for some other algorithms which behave as a TSP heuristic, i.e., 
consider only one vertex in every cluster. We decided to use both approaches 
in our implementations, i.e., to store the weights in a single matrix and, in 
addition, to store a matrix for every pair of clusters. 

2.7 Conclusion 

Several aspects of optimization heuristic design and analysis are discussed 
in this chapter. A lot of attention is paid to the questions of test bed selec- 
tion. Observe that a typical heuristic does not provide any solution quality 
guarantee and, hence, experimental evaluation is vastly important. 

We consider two examples of test bed generation. For MAP, we system- 
atized the existing instance families. For one of these instance families we 
have successfully applied probabilistic analysis in order to estimate the exact 
solution values. Note that for most of instances of this type our estimation 
is really precise. 

There exist several speed-up approaches applicable to virtually any opti- 
mization heuristic. One of these approaches in preprocessing. Observe that 
almost any algorithm hugely depends on the input size. Hence, even a small 
decrease of the instance size may significantly reduce the running time of a 
heuristic. We show an example of GTSP preprocessing which removes some 
vertices and/or edges from an instance if they may not be included in the 
optimal solution. Our experiments confirm the success of this technique. 

At last, we discuss some aspects related to implementation details of 
an algorithm. In turns out that a simple transformation of an algorithm 
may significantly speed it up. We provide an example of a very successful 
optimization of MAP construction heuristics. In addition, we discuss the 
efficiency of several data structures. We show that selecting a proper data 
structure may often improve and simplify an algorithm. 
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Chapter 3 

Local Search Algorithms for 
GTSP 



While GTSP is a very important combinatorial optimization problem and is 
well-studied in many aspects, researches still did not pay enough attention to 
GTSP specific local search and mostly use simple TSP heuristics with basic 
adaptations for GTSP. This section aims at thorough and deep investigation 
of the neighborhoods specific for GTSP and algorithms that can explore these 
neighborhoods quickly. 

We formalize the procedure of adaptation of a TSP neighborhood for 
GTSP and propose efficient algorithms to explore the obtained neighbor- 
hoods. We also generalize all other existing and some new GTSP neighbor- 
hoods. Apart from these theoretical results, we also provide the results of 
a thorough experimental analysis to compare the proposed algorithms im- 
plementations and find out which neighborhoods are the most efficient in 
practice. 

Note that some neighborhoods were used in [961 ESI llOlj - but they were 
not systematized or analyzed in detail. 

We introduce a classification of GTSP neighborhoods. We divide all the 
neighborhoods into three classes: 

1. Cluster Optimization neighborhoods are the neighborhoods which pre- 
serve the cluster order in the tour. This class is discussed in Section ISTT! 



2. TSP neighborhoods are the neighborhoods produced from the TSP 
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ones. They usually perform some global rearrangements in the clus- 



ter order. In Section 3.2.2 we show that there exist several ways to 
adapt a TSP neighborhood for GTSP and propose a number of im- 
provements to make these adaptations fast. We thoroughly investigate 
possible adaptations of the state-of-the-art TSP Lin-Kernighan heuris- 
tic in Section I 



3. Fragment Optimization neighborhoods include only tours which are 
different from the original one in at most some small tour fragment. 



Neighborhoods of this type were not widely used before. In Section 3.4 
we propose two efficient algorithms for these neighborhoods. 

In order to compare the efficiency of different neighborhoods and imple- 



mentations, a series of experiments is conducted in Section 3.5 



3.1 Cluster Optimization 

In this section we discuss GTSP neighborhoods which preserve the order of 
clusters in the tour. In other words, these neighborhoods may only vary the 
vertices within certain clusters. The virtually smallest neighborhood of this 
type is 

Nj^iT, z) = {Ti ^ T2 ^ . . . ^ T,_i ^ 7;' ^ Ti+i T,+2 ^ T™ ^ Ti : T/ G Cluster{Ti)} . 

Its size is |A''l(T, "i)] = | Cluster{Ti)\ and it takes 0{s) operations to explore it. 
One can extend it for two or more clusters: Ni^{T, I), where / is a set of clus- 
ter indices. The size of such neighborhood \Ni^{T,I)\ = HiG/ \ C^'^ster{Ti)\. 
Observe that while the set / contains no neighbor indices, i.e., if « G / then 
i — 1, 2 + 1 ^ /, it takes only 0(|/|s) operations to explore it. If J = + 1}, 
the neighborhood Ni^{T,I) changes its structure. Now it takes O(s^) opera- 
tions to explore it. One may assume that, if / = {i,i + 1, . . . ,i + k — 1}, the 
time complexity of the local search is 0{s''). However, we will show that it 
remains quadratic for any fixed k < m. 

Consider the case when k = m, i.e., when the vertices are optimized in all 
the clusters of the tour. This is the most powerful neighborhood of this type 
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and we call it Cluster Optimization. In fact, there is an exact algorithm CO 
that finds the optimal vertex selection for the whole solution in 0(n7s) time. 
In other words, given a fixed cluster order, it finds the best cycle through 
these clusters. 

CO was introduced by Fischetti, Salazar- Gonzalez and Toth [25] (see its 
detailed description also in [23]) and used in |5ll [871 ES] and others. It is 
based on the shortest path algorithm for acyclic digraphs (see, e.g., [H]). 

Let T = Ti — !■ T2 — )• . . . — !■ Tm — 7- Ti be the given tour and % = 
Cluster {Ti) for every i. The algorithm builds a layered network Geo = 
(Vco^-^co)) where Vco = ^ U 7^' is the set of the GTSP instance vertices 
extended by a copy T{ of the cluster 7i, and Eqq is a set of edges in the 
digraph Geo- An edge x ^ y E Eco exists if there exists i such that x E % 
and y G 7i+i (assume Tm+i = T{). The weight of the edge x ^ y is w{x — )■ y). 
For each vertex f 1 G 7i and its copy v[ G T[', the algorithm finds the shortest 
(fi, v[)-pa.th in Geo- It selects the shortest {vi, v[)-paih which represents the 
best vertex selection within the given cluster sequence. A formal procedure 
based on the dynamic programming approach is presented in Algorithm |2] 
Note that there is no need to repeat the search several times since it finds 

Algorithm 2 Cluster Optimization. Basic implementation. 

Require: Tour T = Ti T2 Ti, where | Cluster(Ti)\ = 7. 

Let Ti = Cluster(Ti) for every i. 
for all r G 7i and f G 72 do 

Set pr,v ^ {r v). 
for z ^ 3, 4, . . . , m do 

for all r G 7i and 1; G 71 do 

Set pr^v Pr,u + (w — ^ v), whcrc u G Ti-i is selected to minimize 
u){pr,u + {u^v)). 

return pr^v + {v r), where r G 7i and v G Tm are selected to minimize 
w{pr,v + {v ^ r)). 



the local minimum after the first run. 

3.1.1 Cluster Optimization Refinements 

Several improvements can noticeably reduce the running time of CO. 
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Observe (see Algorithm [2]) that the algorithm's time complexity grows 
linearly with the size of the cluster 7i. Thus, before applying CO, we rotate 
the solution such that |7i| =7. Hence, the time complexity of the algorithm 
is 0(71,75). Moreover, in some applications one can assume that 7 G 0(1) 
which changes the time complexity to 0{ns). 

This improvement was widely used in the literature. 

Since the running time of the algorithm significantly depends on the size 7 
of the first cluster, it is worth checking whether if we can reduce its size. Some 



attempts to reduce the cluster sizes in GTSP were proposed in Section |2.4 
The idea was to remove a vertex r G i? if for every v & V and u & U there 
exists some r' & R \ {r} such that w{v r' ^ u) < w{v r ^ u), where 
R, U and V are arbitrary distinct clusters. In our case the reduction can 
be significantly more efficient. Indeed, we do not need to consider all the 
combinations of U and V. Let R = Ti- Then the clusters U and V are 
fixed to U = Tm and V = Ti- 

A straightforward reduction algorithm would take 0(s^7^) operations. 
We propose Algorithm ^ which reduces the size of cluster 7i in 0(5^7) time. 



One can try to reduce the size of every cluster but this will likely only slow 
Algorithm 3 Reduction of a cluster in a tour. 

Require: Tour T = Ti T2 —t- — )■ Ti, where | Cluster{Ti)\ = 7. 

Let U = Cluster (Tm), R = Cluster (Ti) and V = Cluster {T2). 
for al\ u eU and v & V do 

Find the shortest distance lu,v ^ m.mr^Rw{u r ^ v). 
Find the number Cu,v of paths m — )■ r — )■ t> such that w{u r ^ v) = lu,v, 
i.e., Cu^y ^ |{r : r G -R and w{u — )• r — )■ t>) = lu,v}\- 
for all r G -R do 

for all u G f/ and v E V do 

if w{u — > r — )• t>) = lu,v and Cu,v = 1 then 
Go to the next r. 
for sd\ u E U and v E V do 
if w{u — )■ r — )• f ) = lu^v then 
Update Cu^y c^^v — 1- 
Remove r from R. 

down the CO algorithm. We apply this reduction only to the smallest cluster 
7i = Cluster (Ti). 
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Note that this reduction is vahd only for a certain cluster order and, 
hence, it is suitable only for a local search of the Cluster Optimization class. 
This means that the cluster 7i should be restored after the run of CO. 

Observe that Algorithm |2] goes sequentially along the tour. However, 
there are many other ways to calculate the shortest paths in a layered network 
using the dynamic programming approach. In particular, one can interpret 
an arbitrary dynamic programming algorithm for the shortest paths as in 
Algorithm |4| Here X is a sequence of m — 2 numbers, 1 < Xi < m — i. 

Algorithm 4 Calculation of the shortest paths in a layered network. 

Require: Network layers 7i, 72, . . . , Tm- 
for ? 1, 2, . . . , m — 2 do 

Find the shortest paths from Tx^-i to Tx^+i- 

Remove the layer Txi and set the weights between Tx,~i and Tx^+i to 
the calculated shortest paths. Renumber the layers. 



It defines the behavior of the algorithm: on the ith. iteration the algorithm 
removes the cluster 7x- from the sequence by calculating the shortest paths 
from 7x,-i to Tx,+i- 

Let us calculate the number of times the CO algorithm takes a weight 
between two vertices. This number adequately reflects the running time of 
the algorithm. 

In general, the dynamic programming algorithm takes 



''optimal 



2 • 



m-2 



i=l 



weight operations. 



(3.1) 



where the ordered lists x, y and z correspond to X. Without loss of generality, 
let Xi < Hi < Zi. 

The sequential algorithm always removes the second cluster in the se- 
quence [Xi = 2 for every i), i.e., the number of weight operations required 
for the algorithm is as follows: 



f = 2 ■ 



m— 1 



I 'Til 1 7^ I + l^il |7i| |7i+i| 



1=2 



(3.2) 
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Consider the following example. Let m be odd, \Ti\ = z > 1 for every 
i = 2, 4, 6, . . . , m — 1 and |7i| = 1 for every i = 1, 3, 5, . . . , m. According to 
(3.2), the sequential algorithm takes 2 ■ {m — 2) ■ z + 2 weight operations. 
Consider a different algorithm which first removes all the clusters 72, 71, . . . , 
Tm-i, it requires only (m — 1) ■ 2; + (m — 3) + 2 weight operations. Hence, 
the ratio is: 

2-(m-2)- z + 2 , m-2 
lim lim r = lim 2 ■ = 2 . 

m-s>oo 2-5-00 [m — 1) ■ Z + [m — 3) + 2 m^oo m — 1 

Note that the time ratio between the sequential calculation and the improved 
one can be significant in practice. Even for the modest values of m = 7 and 
z = 7 in this example the ratio is 1.5. 

A natural question is how much it is possible to speed up the sequential 
algorithm by changing the calculation order. 

Theorem 2 Let the first layer in a layered network be the smallest one. 
Then the sequential (see Algorithm^ calculation of the shortest paths in 
this network is up to 2 times slower than the optimal dynamic programming 
algorithm, and this bound is sharp. 

Proof. Let 7i, 72, • . . , 7^ be the layers of the network. Then Algorithm |4] 
allows one to find all the shortest paths from every vertex in 7i to every 
vertex in 7^. Having these paths, one can find the shortest cycle in 0{s^) 
operations. 

Observe that, whatever is X', the distances between the layers Ti and 



71+1 are used in the algorithm exactly once. In other words, (3.1) contains 
exactly one term which includes |7i||7i+i|. Note that a term in ( 3.1[ ) may be 
either 171-11 |7i| |7I+i| for some i, or |7i| |7I+i| |75|, where j ^ {i — l,i + 2}, or 
l'7i||'7j||7fc|, where j ^ {i — l,i + 1} and k ^ {i — l,i + l,j — 1, j + 1}. 



Let us match every term |7i| |7i| |7i+i| in (3.2) to the term \Txj\\Ty-\\%-\ 
in (3.1 ), where either xj = i and yj = i + 1 or yj = i and zj = i + 1. Observe 
that this term exists and it is the only term containing |7i||7i+i|. Indeed, 
the distances between the clusters % and 71+1 are used exactly once in the 
dynamic programming algorithm. 



Obviously, every term |7^J|7^J|7^J in (3.1) may be matched to at most 



two terms |7i||7^J|7^J and |7i||7^. ||7^. | in (3.2). Now observe that, since 
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\Ti\ < \Tj\ for any j, 

I75l|71||71+i| > |7I||7I||7I+i| for any i and j 

and, thus, 

Hence, 2 ■ ^optimal ^ ^scq- I— I 

However, it would take too long to find the optimal sequence of calcula- 
tions, and, thus, we propose a simple heuristic. On every iteration, it looks 
one step ahead; if the following condition is met: 

ITiiirsiirsi + |ri||r3||r4| > \r2\\%\\%\ + \Ti\\T2\\%\ , (3.3) 

it removes the cluster Ts before removing 72, see Algorithm |5} 

Algorithm 5 Cluster Optimization with an improved order of calculations. 

Require: Tour T = Ti — )■ T2 — > . . . — )■ — )■ Ti, where | Cluster{Ti)\ = 7. 
Let 7i = Cluster{Ti) for every i. 
for i 2, 3, . . . , /c — 1 do 
if 2 < k - 1 and |T[||7I||7^+i| + |T[||7^+i||7^+2| > \Ti\\Ti+i\\Ti+2\ + 
17111711171+21 then 
Calculate the shortest paths from 71 to 71+2- 
Calculate the shortest paths from 7i to 7^+2- 
Set the weights between 7i and 71 to the calculated values. 
Set z <«— z + 1. 
else 

Calculate the shortest paths from 7i to 7i+i. 

Set the weights between 7i and Ti+i to the calculated values. 



3.2 TSP Neighborhoods Adaptation 

GTSP is an extension of TSP and, hence, it is natural to use TSP neighbor- 
hoods for GTSP. In this section we discuss different ways to adapt a TSP 
neighborhood. These approaches are later applied to the most efficient TSP 
neighborhoods. 
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In order to use a TSP neighborhood for GTSP, one may propose sphtting 
GTSP into two problems [92j: solving the TSP instance induced by the 
given tour to find the cluster order and then applying CO algorithm to it 



(see Section 3.1). We will show now that this approach is generally poor 
with regards to solution quality. Let Ntsp(T) be a set of tours which can be 
obtained from the tour T by reordering the vertices in T. Observe that one 
has to solve a TSP instance induced by T to find the best tour in A^tsp(^)- 
Let NcoiT) be the neighborhood of the CO local search (see Section 3.1[ ). 



Recall that the size of NcoiT) neighborhood is |A^co(^)| = Ili^i G 
0{s"^) but it can be explored in the polynomial time. 

The following theorem shows that splitting GTSP into two problems 
(search in Ntsp{T) and then search in A''co(^)) does not guarantee any 
solution quality. 

Theorem 3 The best tour among Nco{T)l-i N^spiT) can be a longest GTSP 
tour different from a shortest one. 



Proof. Consider the GTSP instance G in Figure 3.1a It is a symmetric 
GTSP containing 5 clusters {1}, {2,2'}, {3}, {4} and {5}. The weights of 
the edges not displayed in the graph are as follows: w{l ^ 3) = w{l ^ 4) = 
and w{2 -> 5) = w{2' -> 5) = 1. 

Observe that the tour T = l— !'2— )'3— )'4^'5— t-I, shown in 



Figure 3.1b, is a local minimum in both NcoiT) and N^spiT). The dashed 
line shows the second solution in NcoiT) but it gives the same objective 
value. It is also clear that T is a local minimum in A^tsp(^)- Indeed, all the 
edges incident to the vertex 2 are of weight 1, and, hence, any tour through 
the vertex 2 is at least of weight 2. 

The tour T is in fact a longest tour in G. Observe that all nonzero edges 
in G are incident to vertices 2 and 2'. Since only one of these vertices can 
be visited by a tour, at most two nonzero edges can be included into a tour. 
Hence, the weight of the worst tour in G is 2. 

However, there exists a better GTSP tour Topt = 1— )-2'— )-4— )-3— )■ 

□ 



5 — )■ 1 of weight 1, see Figure 3.1a 
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(a) The instance G and the optimal (b) A local minimum T which is the 
GTSP tour Topt. worst possible GTSP tour. 



Figure 3.1: An example of a local minimum in both A^tsp(2^) and Nco{T) which is a 
longest possible GTSP tour. 

In fact, TSP and GTSP behave quite differently during optimization. 
Observe that there exists no way to find out quickly if some modification of 
the cluster order improves the tour. Indeed, choosing wrong vertices within 
clusters may lead to an arbitrary large increase of the tour weight. And since 
a replacement of a vertex within one cluster may require a replacement of 
vertices in the neighbor clusters, any local change influences the whole tour 
in general case. 

3.2.1 Original TSP Neighborhoods 

In order to continue this discussion, let us briefly list the most known TSP 
neighborhoods. Here we assume that m is the number of vertices in the TSP 
instance. 

/c-opt is the most general TSP neighborhoocQ It includes all the tours which 
can be obtained from the given one by removing k edges and inserting 
k new edges. Obviously any tour can be obtained from a given one by 
an m-opt move. 

Insertion includes all the tours which can be obtained from the given one by 
removing a vertex from the tour and inserting it at some other position. 
It can be represented as a special case of 3-opt. 

^We use the 'fc-opt' notation for both the neighborhood and the local search and specify 
explicitly, if necessary, what is meant in every particular case. Note that in some literature 
this neighborhood is called fc-exchange. 
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Or-opt heuristic is an extension of Insertion. First, it tries to insert every 
fragment of three vertices to every feasible position in the tour; then 
it does the same for every fragment of two vertices and finally it per- 
forms as simple Insertion. Or-opt neighborhood can be represented as 
a special case of 3-opt. 

Swap (also known as Exchange) includes all the tours which can be ob- 
tained from the given one by swapping two vertices in the tour. It can 
be represented special case of 4-opt. 

Lin-Kernighan is a sophisticated heuristic which does not have any certain 
neighborhood; it explores some areas of k-opt neighborhood without 
fixing k. 

For more information on these and some other TSP local searches, see, 

e.g., mm- 



3.2.2 Adaptation of TSP local search for GTSP 

A typical local search with a neighborhood N{T) performs as Algorithm |6] 
Let Ni{T) C Nt^sp[T) be a neighborhood of some TSP local search LSi{T). 

Algorithm 6 Typical local search with neighborhood N(T). 

Require: The original solution T. 
for all r G N{T) do 
if w{T') < w{T) then 

T ^ r. 

Run the whole algorithm again, 
return T. 



Let N2(T) C Nco(T) be a neighborhood of the Cluster Optimization class 



and LS2 be corresponding local search, see Section 3.1 Then one can think 



of the following two adaptations of a TSP local search for GTSP: 

(i) Enumerate all candidates T' G Ni{T). For every candidate T' run 
T' ^ LS2{T') to optimize it in N2{T'). 

(ii) Enumerate all candidates T' G N2{T). For every candidate T' run 
T' ^ LSi{T) to optimize it in iVi(T'). 
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Observe that the TSP neighborhood Ni{T) is normally much harder to 
explore than the cluster optimization neighborhood N2{T). Consider, e.g., 
Ni(T) = A^TSp(^) and N2(T) = Nco(T). Then both options yield an op- 
timal GTSP solution but Option ^ requires 0{n'js ■ m!) operations while 
Option ^ requires 0{s'^ ■ ml) operations. 

Moreover, many practical applications of GTSP have some localization 
of clusters, i.e., \w{x — )■ yi) — w{x — )■ ^2)! ^ max{w{x — )■ yi),w{x — >■ 
7/2)} on average, where Cluster{yi) = Cluster{y2) 7^ Cluster{x). Hence, the 
dependency of the N2{T) landscape on the cluster order is higher than the 
dependency of the Ni{T) landscape on the vertex selection. Hence, Option ^ 
is preferable. 

Option ^ was used in [51]. Note that using N2{T) = Nco{T) would lead 
to a non-polynomial algorithm; the cluster optimization neighborhood N2{T) 
they use includes only the tours which differ from T in exactly one vertex. 
For every T' G N2{T), the Chained Lin-Kernighan heuristic is applied. This 
results in n runs of the Chained Lin-Kernighan heuristic which makes the 
heuristic unreasonably slow while the vertex selection is given a very little 
freedom. 

Option ^ may be improved as in Algorithm [7j Here QuickImprove{T) 

Algorithm 7 Improved adaptation of a TSP neighborhood for GTSP ac- 
cording to Option 

Require: The original tour T. 
for all r G Ni{T) do 
T' QuicklmproveiT') . 
if w(T') < w{T) then 
T ^ SlowImproveiT') . 
Run the whole algorithm again, 
return T. 



and SlowImprove{T) are some tour improvement heuristics of the Cluster 
Otimization class. Formally, these heuristics should meet the following re- 
quirements: 

• QuicklmproveiT) ^ SlowImproveiT) G NcoiT) for any tour T; 
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• w{QuickImprove{T)) < w{T) and w{SlowImprove{T)) < w{T) for any 
tour T. 

Quicklmprove is apphed to every candidate T' before its evaluation. Slowlmprove 
is only applied to successful candidates in order to further improve them. One 
can think of the following implementations of Quicklmprove and Slowlmprove: 

• Trivial /(T) which leaves the solution without any change: I{T) = T. 

• Global cluster optimization CO{T) which applies the CO algorithm to 
the given solution. The time complexity is 0{n'ys). 



• Local cluster optimization L{T) = L(T,I), see Section 3.1 It updates 
the vertices only within clusters i E I, affected by the latest solution 
change. E.g., if a tour xi — )■ X2 — )• — )■ X4 — > Xi was changed to 
xi — > X3 — )■ 0:2 -> X4 — 7- xi, we can use L(T, {2, 3}) which will yield the 
best solution among xi x'^ ^ x'2 X4 ^ Xi, where x'2 G Cluster{x2) 
and X3 G Cluster{x^). The time complexity of L{T) is 0{s) or O(s^) if 
the number of affected clusters is fixed. 

There are five meaningful combinations of Quicklmprove and Slowlmprove: 

Basic QuickImprove{T) = I{T) and SlowImprove{T) = I{T). This actually 
yields the original TSP local search applied to the TSP instance induced 
by the GTSP tour T. 

Basic with CO QuickImprove{T) = I{T) and SlowImprove{T) = CO{T), 
i.e., the algorithm explores the original TSP neighborhood but every 
time an improvement T' is found, it is optimized in Nco{T'). One can 
also consider SlowImprove{T) = L{T), but it has no practical interest. 
Indeed, Slowlmprove is used quite rarely and so its influence on the 
total running time is negligible. At the same time, CO{T) is much 
more powerful than L{T) with respect to solution quality. 

Local Quicklmprove {T) = L{T) and SlowImprove{T) = I{T), i.e., every 
candidate T' G Ni(T) is improved locally before it is compared to the 
original solution. 
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Local with CO QuickImprove{T) = L{T) and SlowImprove{T) = CO{T), 
which is the same as Local but in addition it optimizes every improve- 
ment T' globally in Nco{T'). 

Global QuickImprove{T) = CO{T) and SlowImprove{T) = I{T), i.e., every 
candidate T' G Ni{T) is optimized globally in Nco{T') before it is 
compared to the original solution T. 

For a local search LS we use LSb, LS^, LSi^, LSf^ and LSq to denote 
the Basic, Basic with CO, Local, Local with CO and Global adaptations of 
LS, respectively. 

Some of these adaptations were applied in the literature. For example, the 
heuristics G2 and 03 [92] are actually Global adaptations of 2-opt and 3-opt 
TSP heuristics, respectively. An enhanced implementation of the Global 2- 
opt adaptation is proposed in |5T] ; asymptotically, it is faster than the naive 
implementation by factor 3. Local adaptations of 2-opt and some other 
neighborhoods were used in [251 SD EHJ [96l llOlj . Some Basic adaptations 
were used in [HI SD ESI ES] • 



3.2.3 Global Adaptation 

The most powerful adaptation of a TSP local search for GTSP is the Global 
adaptation. It applies CO to every candidate tour before it is evaluated. In 
other words, if Ni{T) C A^Tgp(T) is the original TSP neighborhood, than the 
adapted neighborhood N{T) is as follows: 

N{T) = [j NcoiT') . 

T'&Ni{T) 



Observe that, apart from other adaptations (see Section 3.2.2), the Global 
one turns a polynomial TSP neighborhood into a very large neighborhood, 
i.e., into a neighborhood of the exponential size which can be explored in 
polynomial time. Indeed, A''co(^i) H Nco(T2) = if the tours Ti and T2 
have different cluster order. Hence, the size of N{T) is exactly 

m 

\N{T)\ = \N,{T)\ ■ H \a\ e 0{\m{T)\ ■ s'") . 

i=l 
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A straightforward exploration of the N{T) neighborhood takes 0{n'js ■ 
lA'^i(T)l). This or shghtly improved approach was apphed in [92] and |51j . 

We propose a new technique which is ri'y/s'^ times faster than a naive 
adaptation. Apart from general discussion of this approach, we also pro- 
vide an example of its application and introduce several efficient speed-up 
heuristics. 

The main idea is to generate the candidates T' G A^i (T) in a certain order 
such that previously calculated shortest paths could be reused. Observe that 
any TSP local search is a special case of k-opt. Indeed, any transformation 
of a TSP tour may be represented as a k-opt move, subject to a sufficiently 
large value of k. 

Let k-opt{T,a, P) be a tour obtained from T by removing the edges a 
and adding the edges (3, where a and /3 are edge sets, |a| = \f3\ = k. We 
need to group all the candidates T' G Ni(T) as follows: 

• Let T^, T^, . . . , T' be a group of candidates and T* = A;-opt(T, a*, /?*). 
The value of k should be the same for all the candidates in the group. 

• Let a = f]. a* and let a'* = a* \ a. Similarly, /3 = Hi /^*- 

• Let Q = T\aU (3, i.e., Q is a set of paths and/or cycles produced from 
T by removing the edges a and adding the edges (3. 

• Removing the edges a'* from Q yields a number of paths, let us say 
PI, P2, . . . , Pk-\/s\- requirement is that every of these paths has at 
least one fixed end: 

beginning{P^) = beginning{P^) for every i and j or 

end{P^) = end{Pl) for every i and j 
for every path index x = 1, 2, . . . , A; — 

• In order to achieve an m-'yis times speed-up, each group should contain 
at least / G G(m) candidates, and the number of edges in every a* 
should be fixed: A; — |a| G 0(1). 
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Algorithm 8 General implementation of the Global adaptation of a TSP 

local search. 

Require: Tour T. 

Require: A group of candidates T^,T^,...,T' such that T* = 
^-opt(T, a\l3'). 

Let a = f]-a^ and /3 = Hi Z^*- Let a'* = a* \ a. 

Let Q = T\aU (3. Let Q \ a* = {Pi Note that the paths 

Pj meet the conditions above. 

forj = l,2,...,fc-|/3| do 

Calculate all the shortest paths through the cluster sequences corre- 
sponding to Pj^, Pj, . . . , Pj. Since one of the ends of all of these paths 
is fixed, this should take only 0{ms^) operations. 

for i = 1,2, ... ,1 do 

Construct a layered network as follows: 

• Each layer 2j — 1 corresponds to the beginning cluster of the path 
pi. 

• Each layer 2j corresponds to the end cluster of the path PJ; 

• The weights of the edges between the layers 2j — 1 and 2j corre- 
sponds to the shortest paths in Pj; 

• The weights of the edges between the layers 2j and 2j + 1 are the 
weights between corresponding clusters. 

• Layer / + 1 is a copy of the layer 1 and the weights between the 
layers 1 and I + 1 are the weights between corresponding clusters. 

Find the shortest cycle C in the constructed layered network using the 
CO algorithm. It will take only 0{{k — ■ s^) = O(s^) operations 
(recall that k - \(3\ E 0(1). 
if w{C) < w{T) then 
T ^C. 

Restart the algorithm, 
return T. 



If the declared above conditions are met, the Global adaptation may be 
implemented as in Algorithm |8| 

Observe that these results can be easily used for the assymmetric case. 
Indeed, even if orientation of some path in the candidate tour does not con- 
incide with orientation of this path in the original tour, one can calculate the 
shortest paths within this fragment in the backward direction. 



3.2. TSP Neighborhoods Adaptation 



62 



Example Implementation 

Let us consider the 2-opt TSP neighborhood and its Global adaptation. Al- 
gorithm [9] enumerates all the candidates in iV2_opt (T) . Observe that all the 

Algorithm 9 Enumeration of all the candidates in the TSP 2-opt neighbor- 

hood. 

Require: The original solution T. 
for X = 1, 2, . . . , m — 2 do 

for y = X + 2,x + 3, . . . , min{m, x + m — 2} do 
List the candidate Turn{T, x,y) (see Section [T|. 



candidates which share the same value of x meet the conditions above (see 
Section 3.2.3[ ). Indeed, for each x there exist 0(m) candidates such that the 
set a' = {T^ -> Tj;+i,Ty(j) -> Ty(^i)+i} and the set f3' = {T^ Ty(^i),T^+i 



Tyii)+i} (see Figure 3.2a). We get a = {T^ — )■ T^+i} and j3 = 0. Hence, 



inserted 



inserted 



x+1 




removed ' 



removed 



(a) The clusters Tx+i and 7^ are fixed while Ty and Ty+i 'slide' 
from left to right. 



Ty + l 



w{u, v) 
u e Tx+i and V E Ty+i 



Tx+i ^ 



Shortest : 
paths 



Shortest : 
paths 



w{u, v) 
u E Tx and v E Ty 



(b) Having all the shortest paths from Ty to Tx+i, and from Ty+i to Tx, 
one can construct this layered network and apply CO to it in order to find 
the shortest cycle in the whole rearranged tour. 



Figure 3.2: Global adaptation of the TSP 2-opt heuristic. 



Q is a path obtained from T by removing the edge — )■ T^+i- Removing 
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the edge a'' = {T, 



Ty(i)+i} sphts Q into two paths T^+i — )■ 



^ T, 



and T^. Observe that the first of these paths has a fixed 

beginning, and the second of these paths has a fixed end. 

The algorithm exploring the neighborhood for some fixed x is presented 



in Algorithm 10 Compare the time complexity of the naive exploration 



Algorithm 10 Global adaptation of the 2-opt heuristic. 
Require: The original tour T. 
Let Ti = Cluster (Ti). 
for s = 1, 2, . . . , m — 2 do 

Calculate the shortest paths along the tour T from every vertex in Tx+i 
to every vertex in Ty and from every vertex in Tx to every vertex in Ty+i 
for every y = x + 2,x + 3, . . . , min{m, x + m — 2}. 
for y = X + 2,x + 3, . . . , min{m, x + m — 2} do 
Construct a layered network as in Figure |3.2b 



Apply CO to this layered network to get the shortest cycle C. 
if w{C) < w{T) then 

Replace T with C. 

Restart the whole algorithm. 



of N2.optiT), which is 0{m'^n'ys), with our adaptation, which takes only 
0{mns'^) operations. If s/7 ^ m, which is a very natural assumption, our 
implementation is significantly faster than the naive one. 



3.2.4 Global Adaptation Refinements 

In certain cases it is possible to significantly speed up the Global adaptation 



algorithm proposed in Section 3.2.3 Consider the 2-optQ implementation 
described in Section 3.2.3 For a fixed x, its time complexity is 0{ns'^ 



A 



more accurate estimation of the number of operations required for every value 



of X IS cLS follows (it consists of calculating the shortest paths, see Figure [372a] 



and finding the shortest cycles, see Figure 3.2b): 



+ J]min||r.l|r.+il • (|7;i + iVil), iTyiiVii- (|7;| + |7;.+i|)}. (3.4) 
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The minimum in (3.4) is taken because our CO implementation finds the 



optimal calculations order if the number of layers in the network is 4 (see 



Section 3.1.1 ). 



Recall that an important property of CO is that its running time hugely 
depends on the size of the first cluster, and, hence, we choose the smallest 
cluster as the first one. Similarly, our 2-opt adaptation depends on the 
clusters 7^, 7^.+i, Ty and 7^+i, but, unfortunately, selection of these clusters 
does not depend on us. However, we can introduce a supporting cluster, i.e., 
break the tour at some extra position, and choose this cluster arbitrarily. 

Without loss of generality, assume that 7i is the smallest cluster in the 
problem: |Tl| =7. If any of Tx, Tx+i, Ty or Ty^i coincide with 7i, then the 
search of the shortest cycle is already quick. Otherwise let us include 7i in 



the layered network (see Figure 3.3). Now it takes only 0{^s ) operations to 



y+l 
A 



Shortest : 
paths 



Shortest 
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Tx 



w{u, v) 
u e Tx+i and V G Ty+i 



w{u, v) 
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Tx+i ^ 



Shortest : 
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Ty 



Figure 3.3: Global adaptation of the TSP 2-opt heuristic with a supporting cluster. 



find the shortest cycle in the rearranged tour. 

Observe that 7i always belongs to the fragment Ty+i, Ty+2, Hence, 
if X 7^ 1 and y + 1 ^ 1 (i.e., y ^ m), then, instead of the shortest paths from 
Ty+i to 7^, we need the shortest paths from Ty+i to Ti and from 7i to 7^, 



see Figure 3.3, Whatever is the calculations scheme, it takes only 0(n7s) 



operations to calculate all the shortest paths between Ty+i and % for a fixed 
X. Moreover, these shortest paths can be reused for different values of x, i.e., 
they should be calculated once for the whole procedure. One only has to 
update some of these paths when a tour improvement is found. 

It is more difficult to speed up the calculations of the shortest paths from 
Ty to Tx+i- Indeed, there is no cluster in this fragment which could be used as 
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a supporting one for all the values of x and y. Our workaround is as follows. 
Consider a problem of finding the shortest paths from every m G Xi to every 
V G Xj, where i = 2, 3, . . . , A; in a sequence Xi, X2, of clusters. 



A straightforward approach to this problem is presented in Algorithm 11 

k 



To proceed, it takes approximately |Xi| ■ |Xi_i||Xj| operations. Since 



its 



i=3 



Algorithm 11 Straightforward calculation of the shortest paths. 

Require: Sequence of clusters Xi, X2, . . . , X^. 
for all u G Xi and f G X2 do 

l{u — 7- f ) ^ w{u — 7- v). 

for z ^ 3, 4, . . . , do 

for all u G Xi and t> G Xj do 

l{u — )■ f ) minigx,_i{^(M — t) + w{t — )■ v)}. 



running time significantly depends on the size of the cluster Xi, we can do the 
following. Let \Xj\ < |Xi| for some j. Then we can calculate all the shortest 
paths lu^^ from every m G Xi to every t G Xj, i = 2,3, . . . ,j, and then for the 
rest of the cluster sequence calculate the shortest paths It^v from every t G Xj 
to every Xj, where i = j + 1, j + 2, . . . , k. This will take approximately 

j k 
|Xi| ■ |Xj_i||Xj| + \Xj\ ■ |Xj_i||Xj| operations. 

i=3 i=j+^ 

Hence, introducing the supporting cluster Xj will save 

k 

|Xi||Xj||Xj+i| + (|Xi| — \Xj\) ■ ^ |Xj_i||Xj| operations. 

i=j+2 

However, the refined algorithm does not yield the shortest paths from m G Xi 
to f G Xfc. It introduces a supporting cluster, which means that one should 
do some additional calculations in order to use the obtained results. In 
particular, the supporting cluster slows down the CO algorithm which is 
applied after each local search move to get the shortest cycle. 

There is no quick way to decide if introducing a supporting cluster is 
beneficial, but we can do some estimation. Let us compare two algorithms: 
with and without the supporting cluster Xj. Observe that these algorithms 
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behave equally for i = 2,3, ... ,j and, thus, we are interested only in i = 
J + + 2,...,k. 

Algorithm |8] consists of two parts: calculation of the shortest paths 
through the tour fragments and calculation of the shortest cycles in the re- 
arranged tours. The second part applies the CO procedure to small layered 
networks in order to find the shortest cycle through the whole tour. Recall 
that CO depends on the size of the smallest layer in the layered network but 
we can guarantee that the constructed layered network contains a layer of 
size 7 (see above). 

Let Xi, X2, . . . , Xfc correspond to Ty, 7^+i, • • • , 7^+i- Without a sup- 
porting cluster, the procedure requires 

(fc \ k 

\Xi\ ■ ^ |Xj_i||Xi| I +7- |Xi| ■ ^ \Xi\ operations. 
i=j+i J i=j+i 

If the supporting cluster exists, it requires 

(fc \ fc 

\Xj\ ■ ^ |Xi_i||Xj| I + 7 ■ |Xj| • ^ (|-^i| + operations. 
i=j+2 J i=j+l 

In order to get some meaningful estimation, let us use the expected value of 



\Ti\=n/m'^ Then we can replace |Xj| with (/c — j) ■ — , and |Xj_i||Xj 

with (k — j) ■ [ — I . Finally we get: 
Vm/ 

tpure = \Xi\{k - j){n/mf + 'j\Xi\{k - j){n/m) and 

tsup = \X,\{k - j){nlmf - \X,\{n/mf + 7|X,-|(A; - j){\Xi\ + n/m) . 

Now we can find the ratio tsup/^puro to determine when it is beneficial to 
^We assume that cluster sizes are distributed uniformly and independantly. 
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introduce the supporting cluster: 



^sup 


X,\{k-3){n/mf- 


X,\{n/mf 


^^\X,\{k-3){\X, 


+ n/m) 


^pure 


Xi\{k- 3){n/my + 7|Xi 1 (fc - 3){n/m) 



Xj\ {n/mY — {n/my /{k — j) + 7(|Xi| + n/m) 



\Xi\ (n/m)2 + 7(n/m) 

We are interested in the case when tgup/i^pure < 1- Hence, we claim 



. (3.5) 



\X\^\X\ jn/mY + -f{n/m) 

' ^' ' {n/niY- (n/mY/ ik~j)+-f {\Xi\+ n/m)' 



Let us substitute some reasonable values to (3.6). Let 7 = 1, — j ^ 1, 
= n/m and n/m = 5. Then \Xj\ < 4.29, i.e., any Xj which is smaller 
than Xi is beneficial. For |Xi| = 2-n/m we get \Xj\ < 7.5, i.e., if the the first 
cluster is large, any cluster even of an average size is suitable as a supporting 
one. 



Observe that the estimation (3.6) was obtained in the assumption that 



we need to apply CO for every possible local search move. In fact, one can 
avoid some of these calculations by using a lower bound. Hence, even if 



the condition (3.6) is not met, it is probable that introducing a supporting 
cluster is still beneficial. Observe also that, having a supporting cluster Xj, 
it is always beneficial to replace it with a new one X^, t > j, if \Xt\ < \Xj\. 



In our implementations we decided to avoid the check (3.6) and introduce a 



supporting cluster as soon as a smaller cluster is found, see Algorithm 12 



In the proposed adaptation, we need to calculate the shortest cycle on 
every iteration, and it takes 0{fs^) time, where / is the number of the 
fragments to be rearranged. Having a lower bound for the shortest cycle, 
one can omit some of these calculations. 

Assume that the rearranged tour T consists of k fragments P^, P^, . . . , P*^ 
such that end{P^) is connected to beginning {P^'^^) and end{P^) is connected 
to beginning {P^)^ where beginning{P'^) (en(i(P')) is the first (the last) cluster 
in P*. Let be the shortest path through the cluster sequence P*. Then it is 
clear that the lower bound for the shortest cycle in this sequence of clusters 
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Algorithm 12 Calculation of the shortest paths with supporting clusters. 

Require: Sequence of clusters Xi, X2, . . . , X^. 
for all M G Xi and v G X2 do 

J'u,v ^ w{u — )■ v). 

Initialize the supporting cluster Z Xi. 
for j ^ 3, 4, . . . , do 
if |Xj_i| < \Z\ then 
if Z 7^ Xi then 

for all u E Xi and v G Xj_i do 

Update the supporting cluster Z ^ ^j-i- 
for all u G Z and v G Xj do 

lu,v ^ wiu — > v). 

else 

for every u & Z and every v G Xj do 
lu,v ^ minpex,_i{^n,p + w{p v)}. 



is 

k 

CO{T) > J2 [w{p') +Wmin {heginmng{P') end{P'^^))] , 

i=l 

where Wmm(X — )• Y) is the weight of the shortest edge from cluster X to 
cluster Y and P^^^ = P\ 

It would take too much time to calculate the shortest paths on every 
iteration. Instead, we propose a lower bound for according to Theo- 

rem HI 

Theorem 4 For the shortest path from an arbitrary vertex in Ta to an ar- 
bitrary vertex in % in a layered network 7i U 72 U . . . U 7^ we have: 

WminiTa Ta+1 . . . ^ %) > w{Ta Ta+l -)-...-> T5) 

l) -W 

max 

+ WminiTa Ta+l) + W„,in{Tb-l ^ Tb) , (3.7) 

where Ti T2 —t- — )■ Ti zs the shortest cycle through all the layers 

of the network. 

Proof. Observe that Ta — ?■ Ta+i — t- T;, is the shortest path from Ta 

to Tb through the layers 7^+i, 7^+i, . . . , T-i- Indeed, if there would exist 
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a shorter path, the condition that Ti — t- T2 — ?■ . . . — ?■ — t- Ti would be 
violated. 

Now assume that there exists some path — )■ T^_^_l T^' which is 



shorter than the lower bound provided in (3.7): 



w{Z ^ T^+i ^ . . . ^ Tl) < w{Ta ^ T,+i ^ . . . ^ n) 

{Ta Ta+l) - Wmax(76-1 T) 

+ Wrmn{Ta -> Ta+l) + «^mm(7b-l -> T) ■ 

Observe that 

w{Ta — )■ T'^j^ 

1 ) ^max {Ta ^ r,+i) < w{T'^ ^ T^,+i) 

^min (7^ 7;+i) and 

Since w{T'^ -+ T,^^ ^ . . . ^ T^) = w{Z ^ T^+i) + ^(T^+i ^ ^ • • • ^ 
TU)+w{TU^T^), we get: 

w{Ta -> T^+i) - Wmax(Ta ^ Xi+l) + Wmin(7^ ^ 7^+l) 

^max (Tfe-i ^ Tb) 

< w{Ta Ta+l ^ ■■■ ^T) - W^^^{Ta ^ Ta+l) " Wmax(7^-1 ^ T'fe) 

+ Wmin(7^ -> 7^1+1 ) + W^min(7b-1 %) ■ 

Hence: 

^i;(r„ ^ T^+i) + «;(r^+i ^ r:+2 ^ . . . -> r,'_i) + w{tu ^ r^) 

< w{Ta -> T„+i -> . . . ^ T;,) or 

«;(T, ^ T^+i ^ ^ . . . -> r,'_i ^ T) < w{Ta ^ T,+i ^ . . . -> r^) . 

The latter means that the path Ta — )■ T^^+i — ?• T^+2 ■ ■ ■ ^ T^'^i — T 
is shorter than — )■ T^+i — )• ... — > T;, but this contradicts with the fact 
that Ta — > Ta+l Tfc is the shortest path from Ta to Tf,. Hence, our 

assumption is wrong. □ 
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Observe that, having precalculated Wraini^ for every pair of clusters 

X and Y and Wmax(a; — )■ Y) and Wmax(^ — ^ x) for every pair of vertex x and 
cluster Y, it takes only 0(1) time to obtain a lower bound according to 
Theorem |4} One also has to apply CO once but the time required for this 
call is usually negligible. 

Our experiments have shown that the usa of the lower bound speeds up 
the 2-opt Global adaptation three times. The lower bound works better 
for large instances since only a fixed number of edges in the lower bound 
are calculated imprecisely while the rest of it corresponds to exact shortest 
paths. 

Another lower bound is even more efficient if one needs the shortest path 
through all the clusters in a broken cycle. 

Theorem 5 For the shortest path from an arbitrary vertex in 7i to an ar- 
bitrary vertex in Tm in a layered network 7i U 72 U . . . U 7^ we have: 

Wmvnijl 7^ . . . Tm) > w{Ti T2 . . . Ti)-Wmax{Tm ^ Tl) , 

where Ti —)■ T2 —)■... —t- — > Ti is the shortest cycle through all the layers 
of the network. 

Proof. Assume there exists a path —)■ such that 

W(T[ T2 . . . T^) < w(Ti T2 ^ . . .Tm Tl) - Wrni,x{Tm) ■ 

Close up this path with the edge — t- T[. Observe that the weight of the 
obtained cycle is 

w{T[ ^T^^ ...^T^^T[) < w{T ...Tm^T) 

+ W(T^ -> T[) - Wrai,^{Tm T) . 

However, this contradicts with the fact that Ti T2 — )■ T is 
the shortest path. Hence, our assumption is wrong. □ 
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3.2.5 A;-opt 

k-opt neighborhood is widely used for TSP and some other combinatorial 
optimization problems, see [251 EOl SI], [96]. It was shown to be very efficient 
in TSP ^50j. In general, Nk_opt{T) contains all the solutions which can be 
obtained from T by selecting k elements in T and then replacing them with 
k new elements such that the feasibility of the solution is preserved. In TSP 
or GTSP, k-opt means replacing k existing edges in the solution with k new 
edges. 

The time complexity of fc-opt increases exponentially with the growth 
of k. In practice only 2-opt and 3-opt are used for TSP [IHl [T^ with rare 
exceptions jHU]. We do not consider k-opt for /c > 3. 



3.2.6 2-opt 

For k = 2 and for a fixed pair of edges — )■ T^+i, Ty — t- T!y+i there are only 
two options for every 2-opt move, i.e., to replace these edges either with — )■ 
Ty and T^+i — )• Ty^i or with Tyj^i — )■ T^+i and Ty ^ T^. However, for the 
symmetric case both options are identical and it takes only 0(1) operations 
to evaluate a 2-opt move, see (1.1). Hence, it takes O(m^) operations to 
explore the whole neighborhood N2-opt{T) in the symmetric case. 

We consider two algorithms to explore the 2-opt neighborhood, namely 
simple and advanced. The simple one tries all feasible pairs of x and y with 



y > X. An efficient approach is used to avoid repetitions, see Algorithm 13 



In particular, the algorithm stores a flag b{Ti) for every vertex Tj. This flag 
shows if the edge which starts from Tj was changed since the last check. 
Observe that a move of Turn(T,x,y) is redundant if both edges T^ — ?■ T^+i 
and Ty — )• Ty^i stay unchanged since the last check of Turn(T,x,y). 

The advanced algorithm is only suitable for symmetric problems. It con- 
siders all the values x G {1, 2, . . . , m} and for every x it takes all feasible y 
such that w{Tx -> Ty) < w{T^ T^+i) or w(T^.+i T^^+i) < w{T^ T^+i). 
Note that every pair of edges can be considered twice in this approach. Hence, 
if a pair of edges was not considered at all, then both wiT^ — j- Ty) > wiT^ — >■ 
Tj+i) and wiT^+i — )■ ^j^+i) > w{Ty — )• Tj^+i) which cannot be an improving 
move. 
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Algorithm 13 Basic 2-opt implementation with an efficient algorithm of 
avoiding repetitions (symmetric case). 

Require: Tour T = Ti —)■ T2 —j- — )■ Ti. 

Initialize b{Ti) -v- true for every i = 1,2, . . . ,m. 
repeat 

Initialize optimal ^ true, 
for X <— 1,2, . . . ,m — 2 do 
Initialize 6^0. 

for y ^ X + 2,x + 3, . . . , min{m, x + m — 2} do 
if b{Tx) = false and b{Ty) = false then 

Go to the next y. 
A ^ w{T^ Ty) + Ty+i) - w{T^ -> - w;(rj^ 

if A < then 

Replace the edges — )■ T^+i and Ty — )■ Ty+i in T with the edges 
T,. and T,.+i ^ Ty+i. 

'Invalidate' vertices: h{Ti) = true for every i = x,x + 1, . . . ,y. 
Set optimal false. 

Start the inner loop from scratch, i.e., y ^ x + 2. 
until optimal = true 



For every vertex v precalculate a list l{v) of vertices l{v)i,l{v)2, ■ ■ ■ and 
order them according to the distance w{v, l{v)i). Now for some x one should 
only consider the ffist entries of /(T^) for the vertex Ty or the ffist entries of 
/(Tj.+i) for Ty^i. For details see 



For the asymmetric problem one standalone move Turn{T,x,y) of 2-opt 
requires 0{m) operations. There are two options to reconnect the fragments 
and each of the options requires one of these fragments to be inverted. How- 
ever, it is still possible to explore the whole neighborhood A^2-opt(T) in O(m^). 
For this purpose the 2-opt moves should be carried out in a certain sequence. 



see Algorithm 14 , On every iteration, the variable 5 stores the weight differ- 
ence caused by ffipping the fragment T^+i — )■ Tx+2 ■ ■ ■ ^ Ty, i.e., 

5 = w(T^+i T^+2 ... ^Ty)- w{Ty Ty_i . . . T^+i) . 

In order to consider the moves Turn{T,x,y) where x > y, inverse the given 
tour T = Tm — )■ Tm^i — 7- . . . — 7- Ti — 7- and apply the procedure again. 
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Algorithm 14 Basic 2-opt implementation for asymmetric problem. 

Require: Tour T = Ti — T2 — . . . — t- Tm — J- Ti. 
for X 1, 2, . . . , m — 2 do 
Initialize 6^0. 

for 1/ •<— X + 2, X + 3, . . . , min{m, x + m — 2} do 
Update 6^6 + w(Ty^i — )■ Ty) — w(Ty — t- Tj^-i). 
A ^ i(7(T^ Tj^) + w(T^+i ^ Ty+i) - w{T^ -> T^+i) - w{Ty 
Tj^+i) - 5. 
if A < then 

The tour T \ {T^ T^+i, Tj^ ^ Tj^+i} U {T,. ^ T^, T^+i Ty+i} is 
an improvement over T. 



Observe that this algorithm's complexity is 0{iv? 



Our Local adaptation of 2-opt (2-optL) is based on Algorithm 13 For 
every pair of x and y it finds the shortest paths T^-i T'^ ^ T'y ^ Ty^i and 
T^+i Ty+i Ty, where T/ G Cluster{Ti) for i G {x,x + l,?/,?/ + l}. 
The time complexity of the local adaptation of 2-opt is 0{mns). 

Our Global adaptation of 2-opt exploits all the approaches proposed in 



Section 3.2.3 Some further discussion of the 2-optQ implementation perfor- 
mance can be found in Section I3.5.3[ 

Note that 2-optQ is naturally suitable for both symmetric and asymmet- 
ric problems. However, in order to explore the whole neighborhood for an 
asymmetric problem, one has to apply the procedure, then inverse the tour 
and apply the procedure again. 



3.2.7 3-opt 

Let us remove the edges — )• T^+i, Ty — i- Ty^i and — )■ Tj+i from a tour 
T. Then there exist eight options to non-trivially rearrange the obtained 
fragments in order to obtain a feasible tour which is not in N2-opt{T). How- 
ever, we limit ourselves to only one of these options, which does not turn any 
of the tour fragments. Note that all the other options can be replaced with 
sequences of two non-independent 2-opt moves ^90]: Turn{Turn(T, x, y),x, z) 
or Turn{Turn{T,x,y),y, z). 
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We implemented all the adaptations (see Section 3.2.2) of the 3-opt neigh- 
borhood and found out that the obtained algorithms are rather slow than 
powerful. However, it is worth noting that the Global adaptation for 3-opt 
can be implemented quite efficiently. Indeed, it takes 0{n'^s) time to find the 
shortest paths from every vertex u to every vertex v ^ Cluster (u) along the 
tour. Then for every triple x, y and z one can find the shortest cycle through 

% Ty+l ry + 2 ^ ... ^ % ^ % + l ^ ... ^ Ty ^ T. + l ^ 

Tz+2 7^ using the the CO algorithm. Hence, the time complexity 

of the algorithm is 0{m?ns^). Using a supporting cluster, one can reduce 
it to 0{m?n'^s + ri^s) operations. Finally, one can apply the lower bound 
for the shortest cycle (see Theorem |4]) which will significantly speed up the 
algorithm. 

3.2.8 Insertion 

The Insertion TSP neighborhood includes all the solutions which can be 
obtained from the given one by removing a vertex and inserting it into some 
other position. Observe that A^ins(T) C A''3-opt(^) (consider 3-opt where one 
of the fragments consist of exactly one vertex). The size of the insertion 
neighborhood is |A^ins(7')| = Tn{m — 2). 



We implement all the adaptations (see Section 3.2.2) for Insertion (Ins). 
As a quick improvement (Quicklmprove) for the local adaptations IhSl and 
lnsL°, we optimize the vertex within the inserted cluster. For a lower bound 
in the Global adaptation (IhSq) we use the results of Theorem [s] 

Some of these adaptations were already used in the literature. For exam- 
ple, IhSl was used in [96] (though it is called there Swap) and in [92j {G-opt 
heuristic). The Move heuristic in [12] is IhSq. However, in [12] the neighbor- 
hood is explored with a heuristic algorithm which does not guarantee that it 
finds a local minimum. 

3.2.9 Swap 

The Swap TSP neighborhood A^swap(r) contains all the solutions obtained 



from T by swapping two vertices in it, see Figure 3.4 , Observe that | A^swap(^) I 
m(m — 1). 
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(a) The original tour T . (b) The tour T after swapping 

Tx and Ty. 



Figure 3.4: A TSP Swap move. 



An improtant message is that Swap does not work well for near-optimal 
solutions. Indeed, a Swap move can be replaced with a sequence of two Ins 
or 2-opt moves. Moreover, the following theorem proves that a 2-opt local 
minimum is also a Swap local minimum for symmetric TSP. 

Theorem 6 Let T he a local minimum in N2-opt{T). Then T is also a local 
minimum in Nswap{T) if the problem is symmetric. 

Proof. Assume that the tour T is a local minimum in A^2-opt(^) but it is 
not a local minimum in Nsv,ap{T). Then there exist some x and y such that 
w{T') < w{T), where T' is obtained from T by swapping and Ty (see 



Figure 3.4): 



w{T^_i -^Ty-^ T^+i) + w{Ty_i ^T^-^ Ty+l) 

< W{T,_, ^ ^ T, + l) + W{Ty,, ^Ty^ Ty+l) . (3.8) 

Let us consider two tours, A = Turn{T, x—1, y) and B = Turn{T, x, y—1)- 



(Without loss of generality, one may assume that x < y.) According to (1.1 ), 



w{A) = w{T)+w{T^_i -> Ty)+w{T^ Ty+i)-w(T^._i T^)-w{Ty Ty+i) and 

w{B) = w{T)+w{T, ^ Ty^i)+wiT,+i ^ Ty)~w{T, ^ T,+i)-wiTy^i ^ Ty) . 

If T is a local minimum in N2-opt{T), then both w{A) —w{T) and w{B) — 
w{T) are non-negative and their sum is also nonnegative. Recall that we 
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consider a symmetric problem and observe that 

[w{A) - w{T)] + [w{B) - w{T)] 
= [w{T,^^i Ty) + w{T^ Ty+i) - w{T,j,_i T,.) - w{Ty T^+i)] 
+ [w{T^ Ty^i) + w{T^+i Ty) - w{T^ T^+i) - w{Ty_i Ty)] 
= [w{T^_i ^Ty-^ Tr+i) + w{Ty^i ^Tj.^ Ty+i] 
- [w{T^^i T^ 



Te+i) + W(Ty^l Ty 



^ Ty+l)] 



However, according to (3.8) this expression is negative and, hence, the as- 
sumption is wrong and the tour T is a local minimum in N2-opt{T). □ 

Note that this effect was also obtained empirically in j^ . 

Till now we considered only the TSP Swap neighborhood. Obviously this 
result can be extended to the Basic adaptation but it is unclear if it holds 
for the Local and Global adaptations. 

Theorem 7 The result of Theorem does not hold for the Local or Global 
adaptations of Swap, i.e., a local minimum in N2-opt g{T) is not necessarily 
a local minimum in Nswap l{L) even if the problem is planar with Euclidean 
distances. 

Proof. We will show an example of GTSP tour T which is a local minimum 
in A^2-opt l(T) but not a local minimum in Ns^^ap l(T). Consider an example 



on Figure 3.5 It is a planar GTSP with Euclidean distances and 8 clusters: 




Figure 3.5: An example of a local minimum in Af2-opt ciT) which is not a local minimum 
in A^'swap l{T). 



{1}, {2}, {3,3'}, {4}, {5}, {6}, {7,7'} and {8}. The initial tour T is 1 ^ 
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2-)-7'-)-4->5-)-6-)-3'-)-8-)-l. Observe that swapping 3' and 7' 
together with optimizing the swapped vertices (i.e., replacing 3' and 7' with 
3 and 7, respectively) produces the optimal tour 1— 7'2— i'3— 7'4— J-S— )■ 
6— )'7— T-S— 7-1. At the same time, obviously no adaptation of 2-opt is able 
to improve T because whatever is the vertex selection, any 2-opt move will 
yield a tour with two intersecting (and, hence, long) edges. □ 



3.3 Lin-Kernighan 

Lin-Kernighan heuristic is known to be one of the most successful heuristics 
for the Traveling Salesman Problem (TSP). Its efficiency is also proven 
in application to some other problems. However, apart from a few naive 
attempts, it was never applied to the GTSP. 

Because of the complexity of the original Lin-Kernighan heuristic, this 
adaptation is not as straightforward as other adaptations discussed in Sec- 



tion 3.2 At first (see Section 3.3.1), we provide an easy-to-understand de- 



scription of a simplified TSP Lin-Kernighan heuristic. In Section 3.3.2[ we 



propose several adaptations, both trivial and complicated ones, and analyze 



them empirically in Section 3.5 



Since Lin-Kernighan is designed for the symmetric problem, we do not 
consider asymmetric GTSP in this research. However, the Global adapta- 



tion of Lin-Kernighan, as it was noted in Section 3.2.3, naturally suits both 
symmetric and asymmetric cases. 

Note that a naive adaptation of Lin-Kernighan for GTSP was already 
proposed in [51]; their algorithm constructed a set of TSP instances and 
solved all of them with the TSP Lin-Kernighan heuristic. Bontoux et al. [12] 
apply the original TSP Lin-Kernighan heuristic to the TSP tours induced by 



the GTSP tours. However, it was shown in Section 3.2.2 that both of these 
approaches are relatively weak. 

3.3.1 TSP Lin-Kernighan Heuristic 

In this section we describe the TSP Lin-Kernighan heuristic (LKtsp). It is a 
simplified version of the original algorithm . Note that [7^] was published 
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almost 40 years ago, when modest computer resources, obviously, influenced 
the algorithm design, hiding the main idea behind the technical details. Also 
note that, back then, the 'goto' operator was widely used; this affects the 
original algorithm description. In contrast, our interpretation of the algo- 
rithm is easy to understand and implement. 

LKtsp is a generalization of the so-called k-opt local search. The fc-opt 
neighborhood A''fc-opt('S') includes all the TSP tours which can be obtained 
by removing k edges from the original tour S and adding k different edges 
such that the resulting tour is feasible. Observe that exploring the whole 
Nk-opt{S) takes 0{n^) operations and, thus, with a few exceptions, only 2- 
opt and rarely 3-opt are used in practice [551 190] - 

As well as fc-opt, LKtsp also tries to remove and insert edges in the tour 
but it explores only some parts of the neighborhood that deem to be the most 
promising. Consider removing an edge from a tour; this produces a path. 
Rearrange the path to minimize its weight. To close up the tour we only 
need to add one edge. Since we did not consider this edge during the path 
optimization, it is likely that its weight is neither minimized nor maximized. 
Hence, the weight of the whole tour is probably reduced together with the 
weight of the path. Here is a general scheme of LKtsp: 

1. Let T be the original tour. 

2. For every edge e — > 6 G T do the following: 

(a) Let P = 6 —7- e be the path obtained from T by removing 
the edge e — )■ 6. 

(b) Rearrange P to minimize its weight. Every time an improvement 
is found during this optimization, try to close up the path P. If it 
leads to a tour shorter than T, save this tour as T and start the 
whole procedure again. 

(c) If no tour improvement was found, continue to the next edge 
(Step§. 

In order to reduce the weight of the path, a local search is used as follows. 
On every move, it tries to break up the path into two parts, invert one of these 



parts, and then rejoin them (see Figure 3.6). In particular, the algorithm 
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tries every edge x y to find one which maximize the gain g = w{x 
y) — w{e — )■ x). If the maximum g is positive, the move is an improvement of 
the path and it is accepted. Note that every move of this local search takes 
0{n) operations. 



(a) The original path. 




(b) The path after a local search move. 

Figure 3.6: An example of a local search move for a path improvement. The weight of the 
path is reduced by w{x y) — w{x ^ e). 

Observe that this algorithm tries only the best improvement and skips 
the other ones. A natural improvement of the heuristic would be to use a 
backtracking mechanism to try all the improvements. However, this would 
slow down the algorithm too much. A compromise is to use the backtracking 
only for the first a moves. This approach is implemented in a recursive 



function ImprovePath(P, depth, R), see Algorithm 15 

Execution of ImprovePath{P, 1, 0) takes 0{rf-depth^^^ operations, where 
depth^^^ is the maximum depth of recursion achieved during the run. Hence, 
one should use only small values of backtracking depth a. 

The presented above algorithm is a simplified Lin-Kernighan heuristic. 
Here is a list of major differences between the described algorithm and the 
original one. 

1. The original heuristic does not accept the first found tour improvement. 
It records it and continues the optimization of the path in the hope of 
finding a better tour improvement. Note that it was reported in [19] 
that this complicates the algorithm but does not really improve its 
quality. 



2. The original heuristic does not try all the n options when optimizing 
a path. It considers only the five shortest edges a; — )■ e in the nonde- 
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Algorithm 15 ImprovePath{P, depth, R) recursive algorithm (LKtsp ver- 
sion). The function either terminates after an improved tour is found or 
finishes normally with no profit. 

Require: Path P = 6 —;■...—)■ e, recursion depth depth and a set of 
restricted vertices R. 
if depth < a then 

for every edge x y E P such that x ^ R do 



Calculate g = w{x y) — w{e — > x) (see Figure 3.6b). 
if 5^ > then 

if the tour 6— i-x—T-e—)-... —?•?/— J-fe is an improvement 
over the original one then 

Accept the produced tour and terminate, 
else 

ImprovePathip —)■...— )-x—)-e—)-.. .—)■?/, depth + 1, i? U {x}). 

else 

Find the edge x — > y which maximizes g = w{x ^ y) — w{e ^ x) . 
if (7 > then 

if the tour 6— )-e—)-.. .—;■?/— )-6 is an improvement over 
the original one then 

Accept the produced tour and terminate, 
else 

return ImprovePath{b j-x—J-e—)-. ..—)■?/, depth + 1,RU 

{x}). 



creasing order. This hugely reduces the running time and helps to find 
the best rather than the first improvement on the backtracking stage. 
However, this speed-up heuristic is known to be a weak point of the 
original implementation |l9l [55]. Indeed, even if the edge x ^ y is 
long, the algorithm does not try to break it if the edge x — ?• e is not in 
the list of five shortest edges to e. 

Note that looking for the closest vertices or clusters may be meaningless 
in the application to GTSP. In our implementation, every edge x — )■ y 
is considered. 

3. The original heuristic does not allow deleting the previously added 
edges or adding the previously deleted edges. It was noted [HI [55] that 
either of these restrictions is enough to prevent an infinite loop. In 
our implementation a previously deleted edge is allowed to be added 
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again but every edge can be deleted only once. Our implementation 
also prevents some other moves, however, the experimental evaluation 
shows that this does not affect the performance of the heuristic. 

4. The original heuristic also considers some more sophisticated moves to 
produce a path from the tour. 

5. The original heuristic is, in fact, embedded into a metaheuristic which 
runs the optimization several times. There are several tricks related to 
the metaheuristic which are inapplicable to a single run. 



3.3.2 Adaptation of LKtsp 

In this section we present our adaptation LK of LKtsp for GTSP. A pseudo- 



code of the whole heuristic is presented in Algorithm [T6j Some of its details 
are encapsulated into the following functions: 

• Gam{P,x — )■ y) is intended to calculate the gain of breaking the path 
P at the edge x — )■ y. 

• RearrangePath{P,x — )■ y) removes the edge x — )■ y from the path P 
and adds the edge a; — )■ e, where P = b^...-^x^y^...^e, see 



Figure 3.6 Together with CloseUp, it includes an implementation of 



QuickImprove{T) (see Section 3.2.2), so RearrangePath may also apply 
some cluster optimization. 

GainIsAcceptable{P, x ^ y) determines if the gain of breaking the path 
P at the edge x — > ?/ is worth some further effort. 

CloseUp{P) adds an edge to the path P to produce a feasible tour. To- 
gether with RearrangePath, it includes an implementation of QuickImprove{T) 



(see Section 3.2.2), so CloseUp may also apply some cluster optimiza- 
tion. 



Improve Tour {T) is a tour improvement function. It is an analogue to 
SlowImprove(T) (see Section 3.2.2). 
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Algorithm 16 LK general implementation 

Require: Original tour T. 

Initialize the number of idle iterations z 0. 
while i < m do 

Cyclically select the next edge e —> b E T. 

Let Po = 6 — 7- . . . — 7- e be the path obtained from T by removing the 
edge e — 7- 6. 

Run T' ^ I'mprovePath{Poi ^) (see below), 
if wiT') < w{T) then 

Set T = ImproveTour{T') . 

Reset the number of idle iterations i ^ 0. 
else 

Increase the number of idle iterations i i + 1. 



Procedure ImprovePath{P, depth, R) 

Require: Path P = 6 — )■ . . . — > e, recursion depth depth and the set of 
restricted vertices R. 
if depth > a then 

Find the edge x^yEP,x^b, x^R such that it maximizes the path 
gain Gain{P,x — > y). 
else 

Repeat the rest of the procedure for every edge x ^ y E P, x b, 
x^R. 

Conduct the local search move: P ^ RearrangePath{P, x ^ y). 
if GainIsAcceptable{P,x — )■ y) then 

Replace the edge x y with a; — )■ e in P. 

r = CloseUp{P). 

if w{T') > w{T) then 

Run T' ImprovePath{P, depth + 1, P U {x}). 
if w{T') < w{T) then 

return T'. 
else 

Restore the path P. 
return T. 



These functions are the key points in the adaptation of LKtsp for GTSP. 
They determine the behavior of the heuristic. In Sections 3.3.3 3.3.4 and 3.3.5 
we describe different implementations of these functions. 
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3.3.3 Basic Variation 

B is the Basic adaptation of LKtsp. It defines the functions Gain, RearrangePath, 
Closellp and ImproveTour as follows: 

Gain-Q{h —)■...—)■ e, x —)■ y) = w{x y) — w{e — )■ x) , 

RearrangePath^{b -^...-^x^y^...^e,x^y) = b^...^x^e^...^y, 

CloseUp^{h -^...^e)=b^...^e-^b, 

and ImproveTour ^{T) is trivial. However, we also consider the Basic with 
CO adaptations B'^" which applies CO every time an improvement is found: 
ImproveTour {T) = CO(T). 

The implementation of GainIsAcceptahle{G,P) will be discussed in Sec- 
tion 13.3.61 



3.3.4 Closest and Shortest Variations 

Closest and shortest variations (denoted as C and S, respectively) are two Lo- 
cal adaptations of LKtsp, i-e., QuickImprove{T) = L{T) and SlowImprove{T) = 
I{T). In other words, some local cluster optimization is applied to every can- 
didate during the path optimization. 

Consider an iteration of the path improvement heuristic ImprovePath. 
Let the path P = 6— >...—)'X— )■?/—;■...— J-e be broken at the edge x ^ y 



see Figure 3.7). Then, to calculate Gain{P,x — )■ y) in C, we replace x G X 



with x' & X such that the edge x — )■ e is minimized: 



= w{p — > X — 7- — w{j) — 7- x' — 7- e) , 

where x' G Cluster{x) is chosen to minimize w{x' e). 

In S, we update both x and e such that the path p— j-x— J-e— J-ris 
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w{x,e) 



Figure 3.7: Path optimization adaptations. 

minimized: 

Gains{b -^...^p^x^y^...-^r-^e,x^y) = 

w{p — 7- X — 7- + w{;r — 7- e) — w{p — )■ x' — e' — t- r) , 

where x' G Cluster{x) and e' G Cluster{e) are chosen to minimize w{p 
x' — )■ e' — )■ r). 

Observe that the most time-consuming part of LK is the path opti- 
mization. In case of the S variation, the bottleneck is the gain evaluation 
function which takes O(s^) operations. In order to reduce the number of 
gain evaluations in S, we do not consider some edges x y. In partic- 
ular, we assume that the gain Gain{b e, x —t- is never larger 
than Wjnin(X, y) —Wjam{X,E), whcrc X = Cluster{x), Y = Cluster{y), 
E = Cluster{e) and w^^i^^A, B) is the weight of the shortest edge from clus- 
ter A to cluster B: 




Wmin(A, B) = min w{a — )■ b) . 
Obviously, all the values Wjami^, B) are precalculated. Note that this speed- 



up heuristic is used only when depth > a, see Algorithm 16 
One can hardly speed up the Gain function in B or C. 
The RearrangePath function does some further cluster optimization in 

the C variation: 



RearrangePathQ{b -^...^p^x^y^...^e, x y) 

= 6— 7-...— )-x'— T-e— T-...— )■?/, 



where x' G Cluster{x) is chosen to minimize the weight w{p — > x' — > e). 
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In S it just repeats the optimization performed for the Gain evaluation: 
RearrangePathg{b —>■...— >-p—>-x—>-y— >■...— >-r—>-e, x— >-y) 

where x' e Cluster{x) and e' e Cluster{e) are chosen to minimize w{p — >■ 
x' ^ e' ^ r). 

Every time we want to close up the path, both C and S try all the com- 
binations of the end vertices to minimize the weight of the loop: 

CloseUpQ^ s{b ^ p ^ . . . ^ q ^ e) ^ b' ^ p ^ . . . ^ q ^ e' ^ b' : 
b' e Cluster (b), e' e Cluster (e) and w{q — >■ e' — >■ 6' — >■ p) is minimized . 

We also implemented Local with CO adaptations C^" and such that 
CO is applied every time a tour improvement is found: ImproveTour{T) — 
CO{T). 

3.3.5 Global Variation 

Finally we propose a Global adaptation G. For every cluster ordering under 
consideration it finds the shortest path from the first to the last cluster (via 
all clusters in that order). After closing up the path it always applies CO. 
However, it explores the neighborhood much faster than a naive implemen- 
tation would do. 

The Gain function for G is defined as follows: 

GainE^b —)■...— )-a;— )>?/—)■...— )-e, x —f y) 

= w^in{b -^...^x^e^...^y)- Wminl^ -^...x^y^...^e), 

where U'min(-P) is the weight of the shortest path through the corresponding 
clusters: 

X2 ^ ■ ■ ■ ^ Xm) = Hliu w{x[ x'^ ^ ■ ■ ■ ^ x'^) . 

G Cluster {xi ),i=l,...,m 

Note that ImprovePath runs this function sequentially for every x ^ y & P. 



3.3. Lin-Kernighan 



86 



Observe that this algorithm meets the conditions declared in Section 3.2.3 
Let Xi = Cluster{xi) for every i. The improved implementation calculates 
the shortest paths from Xi to every f G Xj through X2, X3, . . . , 
where i = 1, 2, . . . , m, in 0{ns) operation^ Then it finds the shortest paths 
from every e G Xm to every q G Xi through Xm-i, Xm-i, ■ ■ ■ , Xi^i for every 
i = 1, 2, . . . , m in 0(?t,s^) operations. Having all these shortest paths, it takes 
O(s^) to find Gain-E using the algorithm for the shortest path in a layered 
network. Finally we get O(ns^) time complexity which is usually much faster 
than the naive exploration in 0{nm'~f operations. 

Observe that the most time consuming part of the algorithm is calculation 
of the shortest paths from e G X^ to g G Xj. However, we apply our improved 



technique (see Section 3.2.4) which significantly speeds up the algorithm (in 
our experiments this speed-up heuristic decreased the running time of the G 
algorithm by 30% to 50%). 

The RearrangePath function for G replaces the edge x ^ y with x — e 
and optimizes the vertices in the path: 

RearrangePath-^lb —)■...— T-a;—)-?/— )■...— T-e) = 6'— )►...— t-x'— )•?/'— )■...— T-e', 
where all the vertices are selected to minimize the weight of the resulting path. 

The CloseUp function for G simply applies CO to the tour: 

CloseUp^ih ^ . . . ^ e) = CO{b ^ . . . ^ e b) . 

Observe that, unlike other adaptations or the original LKtsp heuristic, G 
is naturally suitable for asymmetric instances. 



3.3.6 Gain Function 

Gain is a measure of the path improvement. It is used to find the best path 
improvement and to decide whether this improvement should be accepted. 
To decide this, we use boolean function GainIsAcceptable{P, x — )■ y). This 

■^Indeed, we can add a new cluster Xq — {xq} and set w{xq x'^) — for every 
x'l £ Xi. Then the shortest path from xq to v coincide with the shortest paths from Xi 
to V. 
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function greatly influences the performance of the whole algorithm. We pro- 
pose four different implementations of GainIsAcceptable{P, x — > y) to find 
the most efficient ones: 

1. GainIsAcceptable{P, x — )■ = w{P) < w{Po), i.e., the function ac- 
cepts any changes while the path is shorter than the original one. 

2. GainlsAcceptableiP, x —)■?/) = w(P)-\ < w(T), i.e., it is assumed 

m 

w (T) 

that an edge of an average weight will close up the path. 

m 

3. GainIsAcceptable{P, x y) = w{P) + w{x y) < w(T), i.e., the 
last removed edge is 'restored' for the gain evaluation. Note that the 
weight of the edge x ^ y cannot be obtained correctly in G . Instead of 
w{x — 7- y) we use the weight Wmmi^^y) of the shortest edge between 
clusters X = Gluster{x) and Y = Gluster{y). 

4. GamIsAcceptable{P, x —)■?/) = w{P) < w(T), i.e., the obtained path 
should be shorter than the original tour. In other words, the weight of 
the 'close up edge' is assumed to be 0. Unlike the first three implemen- 
tations, this one is optimistic and, hence, yields deeper search trees. 
This takes more time but also improves the solution quality. 

5. GainlsAcceptableiP, x ^ y) = w(P)-\ < w(T), i.e., it is assumed 

2m 

that an edge of a half of an average weight will close up the path. It is 
a mixture of Options [2] and |4] 
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are 



All the adaptations of the TSP local searches, discussed in Section 3.2 
intended to improve the structure of the whole tour. In this section we discuss 
local improvements, i.e., local search that optimizes only a small fragment of 
a tour on every iteration. 

One can think of many kinds of fragment optimization, but we focus only 
on the most powerful option, i.e., we only consider a neighborhood containing 
all possible rearrangements in a given fragment. 
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Consider a tour T = Ti —> T2 —)■... —t- T,„ — )■ Ti. Let a = Ti, b = Tfc_|_2, 
f2j = Cluster {TiJ^i) for i = 1, 2, . . . , /c and i7 = ^2, • • • , ^fc}- 

Let FO{a, b, Q) be the set of all paths from the vertex a to the vertex b 
through all the clusters in Q being taken in an arbitrary order. Obviously, 
\FO{a,b,Q)\ G 0{k\s^). 

Using the routine for finding the shortest paths in a layered network, one 
can find the best path among FO{a, b, Q) in 0{k\ ■ {k — l)s^) operations. In 
this work we propose two algorithms and J-2 which find the best path in 
FO{a,b,Q) in 0{s'^k\) and 0{s^k'^2^) time, respectively. The objective is to 
find the best permutation tt of the clusters fii, ^2, . . . , fife and the best vertex 
selection within these clusters. 

The first algorithm J^i proceeds as follows. Assume that the first / ele- 
ments in the permutation vr are fixed. Then one only needs to find a per- 
mutation of the rest k — f elements in vr. Let ^^7r(/) = {a^i, 2:2, • • • , Xc\ be the 
last fixed cluster. Let Zi, ^2, • • ■ , be the weights of the shortest paths from a 
to the corresponding vertices in ^^7r(/) through f27r{i), ^7r(2), • • • , ^-wif-i) vis- 
ited in exactly this order. Try to fix to every of the unused clusters 
^] \ {l^^(i), fi^(2), • • • , ^ttC/)}- For each = {x'^, 4, . . . , x'^,} it is easy to 
calculate the weights of the shortest paths /g, • • • , I'c' from a to fi7r(/+i): set 
l[ = mmj{lj + w{xj,x[)}. Now we have / + 1 fixed elements and the values 
l[,l'2y ■ ■ ■ ^^'c'- Apply the procedure recursively. Once all the clusters are fixed, 
i.e., f = k, calculate the total fragment weight mmj{lj + w{xj, b)} and if it is 
shorter than the best one found before then save the solution. To start the 
algorithm, apply the procedure for c = 1, a;i = a and Zi = 0. 

This procedure takes 0{s'^k\) operations, i.e., it is 0{k) times faster than 
a straightforward algorithm. 

The second algorithm J-2 is preferable for large values of k. It is a dy- 
namic programming algorithm which combines the ideas of the Held and 
Karp's TSP algorithm [S2] with the ideas of the layer network shortest path 
algorithm. Let A C f2 be a subset of clusters. We want to find all the short- 
est paths from a to x ^ Un,eA^« clusters A. Observe that 
Px = w{ci ^ x). Assume that we know all the shortest paths Py"^^^^ from a 
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to y through A \ {Y} for every y e where Y — Cluster{y). Then 

Px = , o {Pt^^^^ +w{y^x)} . 

In other words, having the required information, one can find the shortest 
path from a to x via clusters A in 0(|A| • s) operations. Observe that for 
A = Q and x — b the algorithm finds the shortest path from a to 6 via all 
the clusters in the fragment. 

There are (|^|) possible subsets of clusters A of the given size and for every 
subset there are 0{{k — |A|) • s) vertices x. It takes 0(|A| • s) operations to 
find each of these shortest paths. The whole procedure takes 



(fc- |A|) -s- |A| -s =0{s^e2''] 



Hence, for small values of k the first algorithm J^i is preferable while for 
large fragments the second algorithm is significantly faster. 

The corresponding Nk-Fo{T) neighborhood includes all the tours which 
can be obtained from T by reordering any k consequent vertices and varying 
these vertices in the corresponding clusters. Let $f (T) be the set of all tours 
obtained from T by rearranging and varying vertices Tj+i, 7^+2, . . . , Tj+fe. 
Then Nk.Fo{T) = |J"=i ^iC^): to explore this neighborhood we have to 
run our j;, r e {1,2}, algorithm m times. Observe that (T)n$^(T)| > 1 
for some i and j and, hence, our algorithm explores some of the candidates 
in Nk.Fo{T) more than once. It is a natural question if avoiding multiple 
evaluation of these candidates can save any noticeable time. 

Let A'^{T) = {T' e $f (T) : Ti+i}. We assume that k < m/2. 

Then observe that (T) fl Aj{T) = for any i j. Indeed, if some 
r e A^{T) n 4(T) then Tl^^ ^ T^+i and Tj^^ ^ T,+i. Since T' e ^J(T) 
and the vertex Tl_^_^ is modified, we get j < i + 1 < j + k. At the same time, 
since T' e A^{T) and the vertex Tj.^^ is modified, i <j + 1 <i + k. This is 
only possible if i = j. 
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Observe that 

m m 

y$^(T)C{T}uU4'(T) 



i=l i=l 



Indeed, if T' G $f (T) for some i, then either T' = T or there exists i < j < 
i + k such that Tj 7^ Tj and = Tp for every p = z + 1, z + 2, . . . , j — 1. In 
the latter case T' G A^(T). At the same time, 

m m 

{r}uU4'(T)cU$f(r) 

i=l 1=1 

since Af{T) C $f (T) and T G $f (T) for any i. Hence, 

{T} U U (T) = U <|.f (T) = iV,.Fo(T) . 

i=l i=l 

Recall that A^{T)nA'^{T) = and observe that |Af (T)| = O {{ks - l)s''-\k - 
Hence, \Nk.Fo{T) \ = O {m{ks - l)s''-\k - 1)!). 

Compare it to the number 0{ms^k\) of candidates considered by m runs 

of the algorithm J>, r G {1,2}, which is O ( J times larger than 



^ks-1^ 

\Nk-Fo(T)\. We conclude that this relatively small overhead is not worth 
complicating the algorithm. 

Let FOk be the local search with the Nk-Fo{T) neighborhood. Then, 
depending on the implementation, its time complexity is either 0(m/c!s^) or 
0(mA;22V). 



3.5 Computational Experiments 

Theoretical analysis is a useful tool in the algorithm design. However, empir- 
ical analysis is absolutely necessary to select the most efficient neighborhoods 
and algorithms. 



3.5.1 Experiments Prerequisites 

In this section we use the GTSP test bed discussed in Section 12.31 In order 
to save some space, we usually include only every fifth instance in our tables. 
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In order to generate the starting tour for the local search procedures, we 
use a simplified Nearest Neighbor |80j construction heuristic (NN). Unlike 
that proposed by Noon, our algorithm tries only one starting vertex. Trying 
every vertex as a starting one significantly slows down the heuristic and 
almost does not influence the quality of the solutions obtained after applying 
a local search. Note that in what follows the running time of a local search 
includes the running time of the construction heuristic. 

Observe that performance of a local search depends on the initial solution 
and the performance of a stochastic algorithm vary from time to time. To 
smooth out the results, we repeat every experiment 10 times. It requires 
some special measures to ensure that an algorithm H proceeds differently for 
different runs, i.e., H^{I) 7^ H^{I) in general case, where i and j are the run 
numbers. For GK^ (a memetic algorithm which will be discussed later) the 
run number r is the random generator seed value. In NN^, we start the tour 
construction from the vertex Cr,ii i.e., from the first vertex of the rth cluster 
of the instance. This also affects all the local searches since they start from 
the NN'' solutions. 

All the algorithms are implemented in Visual C++; the evaluation plat- 
form is based on an Intel Core i7 2.67 GHz processor. 

3.5.2 Local Search Strategy 

Until now, we considered only the first improvement strategy which applies 
an improvement as soon as it is found. Alternatively, one can use the best im- 
provement strategy which first explores the whole neighborhood and then ap- 
plies the best found improvement. Note that the first improvement strategy 
is normally faster while the best improvement strategy gives better solution 
quality. 

We implemented both strategies for most of the algorithms discussed 
above. The experimental analysis clearly shows that the difference in solution 
quality between the strategies is negligible while the running time is very 
different. Thus, we decided to use only the first improvement strategy in all 
further experiments. 
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3.5.3 Implementations Evaluation 

It is interesting to find out what are the advantages of introducing all the 
improvements discussed above. In this section we compare different imple- 
mentations of the CO, 2-opt and FO algorithms. 

The results of experiments with the CO algorithms are provided in Ta- 
bles A. 6 and A. 7 Table A. 6 includes only the instances with 7 = 1 while 



Table [XTT] includes all the instances with 7 > 1. 



The modifications of CO follows: 
COi is a pure implementation of the algorithm. 

CO2 uses an optimized order of the shortest paths. 

CO3 tries to reduce the size 7 of the smallest cluster. 

CO4 applies both improvements. 

In spite of the fact that all the instances in the test bed had small 7 (the 
largest 7 in the test bed is 3), the experiments clearly show that the cluster 
reduction technique is very efficient (see the results for CO3 and CO4). It was 
able to significantly improve the running times for almost every instance in 
Table A. 7 while, obviously, it does not slow down the algorithm if 7 = 1. 



Note that the differences between COi and CO3, and between CO2 and CO4 
in Table \KM are because of the measurement errors. 

The optimized calculations order is also beneficial, but not by much. It 
is more efficient when 7 > 1. Indeed, it is easy to see that if 7 = 1 and 



the condition (3.3) is met, then either |72| = 1 or \7l\ = 1. Hence, this 
improvement can be applied quite rarely and only if at least two clusters 
involved in the calculation are of size 1, i.e., the whole calculation in relatively 
fast itself. 

We conclude that the proposed refinements are usually insignificant if 
7 = 1 but they are very efficient if 7 > 1. However, for some other test 
bed both cluster reduction technique and optimized calculations order may 
become crucial for the algorithm's efficiency. 



Table |A.8| reports the running times of two Basic and two Global adap- 
tations of 2-opt. For details of the 2-optB and 2-optB'^^ implementations see 
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Section 3.2.6 2-optQ is a fully optimized implementation which applies all 



the improvements discussed in Section 3.2.4[ In contrast, 2-optQ™^''^ is a 



simplified variation of the algorithm which uses the dynamic programming 
approach to calculate the shortest cycle for every 2-opt move but it does not 
introduce any supporting clusters or lower bounds. 

One can see that 2-optB'^^ is usually inefficient for GTSP. Observe that 
the time required to generate the lists l{v) is 0{m'^ logm) while it takes only 
0{m?) operations to explore the whole neighborhood N2-opt{T). Moreover, 
in order to use the lists several times, i.e., for different GTSP tours, one 
should include clusters C, not vertices, in the lists l{v) and use the maximum 
distance Wmax('y C) when ordering the lists. An obvious speed-up heuristic 
is to include in l{v) only the vertices (clusters) which are close to v. However, 
this still does not improve the algorithm enough to compete with the first 



2-opt implementation, see Algorithm 13 We assume that 2-optB*^^ may be 



useful as a part of a powerful metaheuristic which applies 2-opt many times 
for one instance; then the lists /(f) are repeatedly reused. 

As regards the Global implementations, it follows from our experiments 
that, on average, 2-optQ is more than 10 times faster than 2-optQ™^^'^. Note 
that the speed-up is higher for large instances. This is because the lower 
bound is more accurate for large values of m. 

We have two algorithms to explore the Nk-Fo{T) neighborhood; the first 
algorithm is faster for small values of k while the second one is faster for 



large k. Table A. 9 compares the running times of both algorithms. It is 
clearly visible that the first implementation is faster for k < 4 while for 
k > 4 the second implementation is preferable. Observe that already for 
k = 7 the difference in performances of the algorithms is significant and it is 
approximately the same for all the instances in the test bed. 

3.5.4 Simple Local Search Evaluation 

In this Section we provide and discuss the results of all the simple local search 
algorithms discussed above. 



The results for 2-opt adaptations are provided in Table A. 10 The Basic 



adaptation 2-optB is the fastest and the weakest one. It takes only 1 ms to 
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proceed even for the largest instances, however, it is not able to change the 
vertex selection which makes its solution quality noncompetitive. The 2-optB° 
modification, thus, is significantly better with respect to solution quality and 
it is not much slower. Other adaptations further improve the results at the 
cost of noticeably larger running times. However, though the neighborhood 
of 2-optQ is much larger than all other 2-opt neighborhoods, it is only about 
3 times slower than 2-optL or 2-optL°. This shows again the efficiency of the 



refinements proposed in Section 3.2.4 



Similar results are obtained for the Ins adaptations, see Table A. 11 The 
Basic adaptation is extremely fast, though it is not as fast as 2-optB is. The 
cluster optimization in Insg" significantly improves the solution quality of the 
heuristic. All other adaptations are significantly slower. IhSq is again about 
3 times slower than IhSl or Ins^". Note that Ins™ and especially IhSq find the 
optimal solutions for some small instances. 



Finally we provide the results for the FO algorithm, see Table A. 12 Note 
that we use the first algorithm for k < 4 and the second algorithm for k > 4, 
see Sections |3.4| and [3. 5. 3[ Obviously, the heuristic yields very good solutions 



when k is close to m, but it is quite slow for large values of k. We conclude 
that the most reasonable values of k are 2, 3, 4, 5 and sometimes 6. 

FO neighborhood is rather interesting in combination with some other 
neighborhoods than as a stand-alone heuristic. However, combination of 
several neighborhoods is a subject for a separate research. 

3.5.5 Fair Competition 



Observe that the number of LK variations presented in Section 3.3.1 is really 



huge and one cannot report and compare the results of these heuristics like 



we did in Section 3.5.4 In fact, the problem of a fair comparison of several 
heuristics is quite common. Indeed, every experiment result consist of at 
least two parameters: solution error and running time. It is a trade-off 
between speed and quality, and both quick (and low-quality) and slow (and 
high-quality) heuristics are of interest. A heuristic should only be considered 
as useless if it is dominated by another heuristic, i.e., it is both slower and 
yields lower quality solutions. 
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Hence, one can clearly separate a set of successful from a set of domi- 
nated heuristics. However, this only works for a single experiment. If the 
experiment is conducted for several test instances, the comparison becomes 
unobvious. Indeed, a heuristic may be successful in one experiment and 
unsuccessful in another one. A natural solution of this problem is to use 
average values but it is often incorrect to compare solution qualities and run- 
ning times for different instances. E.g., if some algorithm takes ti = 1 second 
to solve some test instance and it takes t2 = 100 seconds to solve another 
test instance, the average running time tavg = (^i + h)/'^ for this algorithm 
would not actually include the results of the first experiment: tavg ~ ^2/2. 

In a fair competition, one should compare heuristics which have similar 
running times. For every time G {0.02 s, 0.05 s, 0.1 s, 0.2 s, . . . , 50 s} 
we compare solution quality of all the heuristics which were able to solve an 
instance in less than r,. In order to further reduce the size of the table and to 
smooth out the experimental results, we additionally group similar instances 
together and report only the average values for each group. Recall also that 



we additionally repeat every experiment 10 times, see Section 3.5.1 
The following heuristics were included in the experiments: 

1. The Basic variations of LKtsp, i.e., B" and B"'^", where a G {2,3,4,5} 
and X G {1,2,3,4} define the backtracking depth and gain acceptance 
strategy, respectively. 

2. The Closest variations of LKtsp, i-e., C° and C"^°, where a G {2,3,4} 
and X G {1,2,3,4,5}. 

3. The Shortest variations of LKtsp, i-e., S" and S"™, where a G {2,3,4} 
and X G {1,2,3,4,5}. 

4. The Global variations of LKtsp, i-e., G", where a G {1,2,3} and x G 
{1,2,3,4,5}. 

5. FOfc for A; = 2, 3, . . . , 10 and adaptations of 2-opt (2o), 3-opt (So) and 



Insertion (Ins) local searches according to Section 3.2.2 Note that 
the adaptations used in this comparison include most but not all the 
improvements described above. 
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6. The state-of-the-art memetic algorithm GK which will be discussed in 
detail in Section 15. 1[ 



Finally we get Table A. 13 Roughly speaking, every cell of this table 



reports the most successful heuristics for a given range of instances and being 
given some limited time. More formally, let r = {ti,T2, . . .} be a set of 
predefined time limits. Let X = {Xi,X2, . . .} be a set of predefined instance 
groups such that all instances in every Ij have similar difficulty. Let H be a 
set of all heuristics included in the competition. if(/)time and if(J)error are 
the running time and the relative solution error, respectively, of the heuristic 
if G for the instance / G X: 

rT(n _ w{H{I)) -Wjhest) 
\-l Jerror / t \ ' 

W{Ihcst) 

where /best is the optimal or best known solution for the instance /. i/(Xj)time 
and i/(Xj)error dcuotc the corresponding values averaged for all instances 
/ elj and all r G {1, 2, . . . , 10}. 

For every cell i,j we define a winner heuristic Winner eT-L a.s follows: 

1. Winner^ j{I)timc < Tj for every instance / G Ij and every r G {1, 2, . . . , 10}. 

2. Winner ij(Xj) error < Winner i^ijiXj) error (it is only applicable if i > 1). 

3. If several heuristics meet the conditions above, we choose the one with 

the smallest if jj(Xj) error- 

4. If several heuristics meet the conditions above and have the same so- 
lution quality, we choose the one with the smallest Hij(Ij)tirae- 

Apart from the winner, every cell contains all the heuristics H which 
meet the following conditions: 

1. H^{I)tirae < for evcry instance i G Zj and every r G {1, 2, . . . , 10}. 

2. H(Zj)crror < Winner i^i^j{Xj) error (it is only applicable if z > 1). 

3. H{Xj)error < 1-1 " W^mncrj j (X^) error- 

4. ii (Xj)tinie < 1-2 ■ W inner ij{Xj)time- 
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Since LK is a powerful heuristic, we did not consider any instances with 
less than 30 clusters in this competition. Note that all the smaller instances 
are relatively easy to solve, e.g., GK was able to solve of them to optimality in 
our experiments, and it took only about 30 ms on average, and for Sg™ it takes 



less than a half millisecond to get 0.3% error, on average, see Table A. 14 
We use the following groups Xj of instances: 

Tiniest includes 30chl50, 30kroA150, 30kroB150, 31prl52, 32ul59 and 
39ratl95. 

Tiny includes 40kroa200, 40krob200, 41gr202, 45ts225, 45tsp225 and 
46pr226. 

Small includes 46gr229, 53gil262, 56a280, 60pr299 and 641in318. 

Moderate includes 80rd400, 84f 1417, 87gr431, 88pr439 and 89pcb442. 

Large includes 99d493, 107att532, 107ali535, 113pa561, 115u574 and 
115rat575. 

Huge includes 132d657, 134gr666, 145u724 and 157rat783. 

Giant includes 200dsjl000, 201prl002, 212ul060 and 217vml084. 

Note that the instances 35sil75, 36brgl80, 40dl98, 53pr264, 107si535, 
131p654 and 207sil032 are excluded from this competition since they are 
significantly harder to solve than the other instances of the corresponding 



groups. This is discussed in Section 3.5.6 and the results for these instances 



are included in Tables IA.15I and lA. 161 

One can see from Table A.13| that there is a clear tendency: the proposed 



Lin-Kernighan adaptation outperforms all other heuristics in a wide range of 
trade-offs between solution quality and running time. Only the state-of-the- 
art memetic algorithm GK is able to beat LK being given large time. There 
are several occurrences of 2-opt in the upper right corner (i.e., for Huge and 
Giant instances and less than 5 ms time) but this is because this given time 
is too small for even the most basic variations of LK. 

Clearly, the most important parameter of LK is its variation, and each 
of the four variations (basic, closest, shortest and global) is successful in a 
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certain running time range. B wins the competition for small running times. 
For the middle range of running times one should choose C or S. The G 
variation wins only in a small range of times; having more time, one should 
choose the memetic algorithm GK ^T] . 

Here are some tendencies with regards to the rest of the LK parameters: 

• It is usually beneficial to apply CO every time a tour improvement is 
found. 

• The most successful gain acceptance options are |4] and [s] (see Sec- 
tion 



3.3.6). 



The larger the backtracking depth a, the better the solutions. However, 
it is an expensive way to improve the solutions; one should normally 
keep a e {2,3,4}. 



Table A. 13, however, does not make it clear what parameters one should 
use in practice. In order to give some recommendations, we found the dis- 
tance d{H) between each of the heuristics H ETi to the winner algorithms. 



For every column j of Table A. 13 we calculated dj{H): 
d,{H) 



-^(-^')error I^'^^^^^^j' (-^')error 



Winner i^jiX^ 



■J J error 



where i is minimized such that H^{I)timc < Ti for every / G Ij and r G 
{1,2,..., 10}. Then dj{H) were averaged for all j to get the required dis- 
tance: d{H) = dj{H). The list of the heuristics H with the smallest distances 



d{H) is presented in Table 3.1 In fact, we added 2o™, 62*^° and G4 to this 



list only to fill the gaps. Every heuristic H in Table 3.1 is also provided with 



the average running time T[H), in % of GK running time: 



T{H) = T{H, J, r) averaged for all instances / G X and all r G {1, 2, . . . , 10} 
where T{H, I, r) = ^^j^ ■ 100% 

MA[1 Jtime 



and MA{I)time = MA''{I)time averaged for all r G {1, 2, . . . , 10} . 
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Table 3.1: List of the most successful GTSP heuristics. The heuristics H are ordered 
according to their running times, from the fastest to the slowest ones. 



H 


d{H), % 


Time, % of GK time 




44 


0.04 


Br° 


34 


0.10 


(~2co 
^5 


12 


0.40 


C2co 
•^5 


19 


0.97 


c3co 
•^5 


19 


2.53 


C4co 
-^5 


35 


8.70 


C4co 
J4 


32 


15.34 


Gl 


56 


43.62 


GK 





100.00 



3.5.6 Experiment Details for Selected Heuristics 

In this section we provide detailed information on the experimental results for 
the most successful heuristics, see Section 3.5.5 Tables A.14 , [XTTS and A. 16 
include the following information: 

• The 'Instance' column contains the instance name as described above. 

• The 'Best' column contains the best known or optimal objective values 
of the test instances. 



The rest of the columns correspond to different heuristics and report 
either relative solution error or running time in milliseconds. Since the 
results of the local searches depend on the initial tour and the memetic 
algorithm is non-deterministic, we averaged every value in these tables 



for ten runs, see Section 3.5.5 for details. 



The 'Average' row reports the averages for all the instances in a table. 

The 'Light avg' row reports the averages for all the instances used in 
Section 13.5.51 

Similarly, the 'Heavy avg' row reports the averages for all the instances 



(m > 30) excluded from the competition in Section 3.5.5 
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All the small instances (m < 30) are separated from the rest of the test 
bed to Table IJll One can see that all these instances are relatively easy 
to solve; in fact several heuristics are able to solve all or almost all of them 
to optimality in every run and it takes only a small fraction of second. A 
useful observation is that G4 solves all the instances with up to 20 clusters 
to optimality, and in this range G4 is significantly faster than GK. 

As regards the larger instances (m > 30), it is worth noting that there 
exist several 'heavy' instances among them: 35sil75, 36brgl80, 40dl98, 
53pr264, 107si535, 131p654 and 207sil032. Some heuristics perform ex- 
tremely slowly for these instances: the running time of S5™, Sf^°, Sf'" and 
G| is 3 to 500 times larger for every 'heavy' instance than it is for the other 
similar size instances. Other LK variations are also affected, though, this 
mostly relates to the ones which use the 'optimistic' gain acceptance func- 
tions (Options [i] and [5]), see Section 3.3.6 



Our analysis has shown that all of these instances have an unusual weight 
distribution. In particular, all these instances have enormous number of 
'heavy' edges, i.e., the the weights which are close to the maximum weight 
in the instance, prevail over the smaller weights. Recall that LK bases on 
the assumption that a randomly selected edge will probably have a 'good' 
weight. Then we can optimize a path in the hope to find a good option to 
close it up later. However, the probability to find a 'good' edge is low in the 
'heavy' instances. Hence, the termination condition Gainis Acceptable does 
not usually stop the search though a few tour improvements can be found. 
This, obviously, slows down the algorithm. 

Observe that such 'unfortunate' instances can be easily detected before 
the algorithm's run. Observe also that even the fast heuristics yield relatively 



good solutions for these instances (see Tables A. 15 and A. 16). Hence, one 
can use a lighter heuristic to get a reasonable solution quality in a reasonable 
time in this case. 



3.6 Conclusion 



Several GTSP neighborhoods are discussed and evaluated in this chapter. 
Special attention is paid to adaptation of a TSP neighborhood for GTSP 
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and to exploration of the adapted neighborhood efficiently. Theoretical anal- 
ysis shows that these algorithms are significantly faster than any algorithms 
known from the literature, and the experiments confirm the success of our 
approaches. 

Important theoretical results were obtained for the Cluster Optimization 
procedure which is widely used in the literature because of its efficiency, 
simplicity and perfect theoretical properties. Our tuned implementation of 
the algorithm showed a noticeable improvement over the original one in our 
experiments. We have also proven that the best implementation of Cluster 
Optimization cannot be significantly faster than the proposed algorithm. 

A new class of GTSP neighborhoods, namely Fragment Optimization, is 
introduced in the work. It is an exponential neighborhood, and we proposed 
two efficient algorithms to explore it. 

A number of adaptations of the Lin-Kernighan heuristic for GTSP is 
presented. The experimental evaluation confirms the success of these adap- 
tations. 

Based on the experimental results, we selected the most successful heuris- 
tics for different solution quality /running time requirements. Note that this 
list mostly consists of LK adaptations. However, this does not mean that the 
simple local searches have no practical application. These neighborhoods are 
not intended to be used alone but they are expected to be very efficient in 
combination with some other local search. This is a subject of our future 
research. 
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Chapter 4 

Local Search Algorithms for 
MAP 



In this chapter we collect and generalize all MAP local search heuristics 
known from the literature, propose some new neighborhoods and evaluate 
them all both theoretically and experimentally. 

Recall that we consider only the general case of MAP and, thus, all the 
heuristics relying on any special structures of the weight matrices are not 
included in our comparison. 



4.1 Dimensionwise Variations Heuristics 

The heuristics of this group were first introduced by Bandelt et al. [8] for 
MAP with decomposable costs. However, having a very large neighborhood 
(see below), they are very efficient even in the general case. The fact that 
this approach was also used by Huang and Lim as a local search procedure 
for their memetic algorithm [52] confirms its efficiency. 

The idea of the dimensionwise variation heuristics is as follows. Con- 
sider the initial assignment A in the permutation form A = 1x1712 ■ ■ - t^s (see 



Section 1.2). Let p{A, pi, p2, . . . ,ps) be an assignment obtained from A by 



applying the permutations pi, p2, ■ ■ ■ , Ps to tti, 7r2, . . . , vr^ respectively: 



p{A, pi, p2, . . . , Ps) = Pi(vri)p2(vr2) . . .Ps(vr,) . (4.1) 
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Let Pd{^, p) be an assignment p{A, pi, p2, . . . , Ps), where pj — pii j & D and 
Pj — In otherwise (1„ is the identity permutation of size n): 



pd{a,p)^p{ a, 



In otherwise ' 1 1„ otherwise ' ' 1 In otherwise / 



(4.2) 

On every iteration, the heuristic selects some nonempty set D C {1,2, . . . , s} 
of dimensions and searches for a permutation p such that w{pd{A, p)) is 
minimized. 

For every subset of dimensions D, there are n\ different permutations p 
but the optimal one can be found in the polynomial time. Let swap{u,v, D) 
be a vector which is equal to vector u in all dimensions j G {1, 2, . . . ,s}\D 
and equal to vector v in all dimensions j & D: 

swap{u,v,D)j^ \ ' for j = l,2,...,s. (4.3) 

[ Vj ifj e D 

Let matrix [Mjj]„xn be constructed as 

Mij = w(swap{A\ A\ D)) . (4.4) 

It is clear that the solution of the corresponding 2-AP is exactly the required 
permutation p. Indeed, assume there exists some permutation p' such that 
'w{pd{A,p')) < w{pd{A,p)). Observe that pd{A,p) = {swap{A\ A^^"^ , D) : 
i e {1, 2, . . . , n}}. Then we have 

n n 

^w(swap(A\^'''«,D)) < ^w(swap(^\ A^W,!^)) . 

i=l i=l 

Since w{swap{A\ Ap^^ , D)) = Mj,p(i), the sum Y^'^^^wiswapiA^ Ap^^ , D)) is 
already minimized to the optimum and no p' can exist. 

The neighborhood of a dimensionwise heuristic is as follows: 

N-£,y{A) = |p£)(A, p) : D eV and p is a permutationj , (4.5) 



where T> includes all dimension subsets acceptable by a certain heuristic. 
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Observe that 

PD{A,p)=pj,{A,p-^), (4.6) 
where p^^{p) = p{p^^) = Is and D = {1, 2, . . . , s} \ and, hence, 

{pz)(y4, p) : p is a permutation} = |pjj(yl,p) : p is a permutation} (4.7) 



for any D. From (4.7) and the obvious fact that p0{A, p) = P{i,2,...,s}iA, p) 



A for any p we introduce the following restrictions for V: 

DeV^D^V and 0, {1,2, . . . , s} ^ V . (4.8) 

With these restrictions, one can see that for any pair of distinct sets Di,D2 G 
V the equation pDj^{A,pi) = pD2{A,p2) holds if and only if pi = P2 = In- 
Hence, the size of the neighborhood A^dv(^) is 

\Nj)y{A)\ = \V\ ■ {n\ - 1) + 1 . (4.9) 

In [8| it is decided that the number of iterations should not be expo- 
nential with regards to neither n nor s while the size of the maximum V is 
\X>\ = 2*^^ — 1. Therefore two heuristics, LSI and LS2, are evaluated in [8]. 
LSI includes only singleton values of D, i.e., V = {D : \D\ = 1}; LS2 in- 
cludes only doubleton values of D, i.e., V = {D : \D\ = 2}. It is surprising 
but according to both [8j and our computational experience, the heuristic 
LS2 produces worse solutions than LSI though it obviously has larger neigh- 
borhood and larger running times. We improve the heuristic by allowing 
\D\ < 2, i.e., V = {D : \D\ < 2}. This does not change the theoretical time 
complexity of the algorithm but improves its performance. The heuristic 
LSI is called IDV in our research; LS2 with \D\ < 2 is called 2DV. We also 



assume (see Section 1.2) that the value of s is a small fixed constant and. 



thus, introduce a heuristic sDV which enumerates all feasible (recall (4.8)) 
Dc{l,2,...,s}. 

The order in which the heuristics take the values D E V in our imple- 
mentations is as follows. For IDV it is {1}, {2}, . . . , {s}. 2DV begins as 
IDV and then takes all pairs of dimensions: {1, 2}, {1,3}, . . . , {1, s}, {2, 3}, 



{s — 1, s}. Note that because of (4.8) it enumerates no pairs of vectors 
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for s = 3, and for s = 4 it only takes the following pairs: {2,3}, {2,4} and 
{3,4}. sDV takes first all sets D of size 1, then all sets D of size 2 and 
so on up to \D\ = \_s/2\. If s is even then we should take only half of the 



sets D of size s/2 (recall (4.7)); for this purpose we take all the subsets of 
Z^c{2,3,...,s}, 



\D\ = s/2 in the similar order as before. 
It is obvious that Nij)y{A) C N2by{A) C Nsdy{A) for any s; however 
for s = 3 all the neighborhoods are equal and for s = 4 2DV and sDV also 
coincide. 



According to (4.8) and (4.9), the neighborhood size of IDV is 



|iVlDv(^)| 



1) + 1, 



of 2DV is 

|iV2Dv(A)| 



(2^-1 - 1) ■ (n! - 1) + 1 ifsG{3,4} 
(Q)+s)-(d-l) + l ifs>5 



and of sDV is 

|iV,Dv(A)| = (2'^-^-l)-(n!-l) + l. 

The time complexity of every run of DV is Od^l ■ n^) as every 2-AP 
takes 0{n^) and, hence, the time complexity of IDV is 0{s ■ n^), of 2DV is 
0(s2 ■ n^) and of MDV is 0(2^-^ ■ n^). 



4.2 /c-opt 

The fc-opt heuristic for 3-AP for k = 2 and k = 3 was first introduced by 
Balas and Saltzman [7] as a pairwise and triple interchange heuristic. 2-opt 
as well as its variations were also discussed in [H [121 [771 ED ESI [S3] and some 
other papers. We generalize the heuristic for arbitrary values of k and s. 

The heuristic proceeds as follows. For every subset of k vectors taken in 
the assignment A it removes all these vectors from A and inserts some new 
k vectors such that the assignment feasibility is preserved and its weight is 
minimized. Another definition is as follows: for every set of distinct vectors 
e\e2,...,e^ G A let = {e], e^, . . . , e^^} for j = l,2,...,s. Let A' = 
{e'^,e'^, . . . ,e'^} be a solution of this s-AP of size k. Replace the vectors 
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e^, e^, . . . , e*^ in the initial assignment A with e'^, e'^, . . . , e'^. 

The time complexity of fc-opt is obviously O ((2) ■A;!''"^); for ^ n 
it can be replaced with 0{n^ ■ k\^~^). It is a natural question if one can 



use some faster solver on every iteration. Indeed, according to Section 1.2 
it is possible to solve s-AP of size k in 0(/c!''~^ ■ k^). However, it is easy 
to see that k\^~^ < ■ k^ for every k up to 5, i.e., it is better to use 

the exhaustive search for any reasonable k. One can doubt that the exact 
algorithm actually takes k\'^~'^ ■ k^ operations but even for the lower bound 
■ fc^) the inequality k\'^~^ < fc!"*"^ ■ k"^ holds for any k < 3, i.e., for all 
the values of k we actually consider. 

Now let us find the neighborhood of the heuristic. For some set X and 
a subset / C X let a permutation p of elements in X be an I -permutation if 
p{i) = i for every i & i.e., if p does not move any elements except ele- 

ments from I. Let E = {e^, e^, . . . , e'^} C A be a set of k distinct vectors in A. 
For j = 2, 3, . . . , s let pj be an i^^-permutation, where Ej = {e], e^, . . . , e^}. 
Then a set E) of all assignments which can be obtained from A by 

swapping coordinates of vectors E can be described as follows: 

Vr(y4, E) = {p{A, In, p2, P3, ■ ■ ■ , Ps) '■ Pj is an i?j-permutation for j = 2, 3, . . . 

Recall that 1„ is the identity permutation of size n and p{A, pi, p2, . . . , Ps) is 



defined by (4.1). 



The neighborhood A'"fc_opt(^) is defined as follows: 

Nk-opM)= U W{A,E). (4.10) 

EcA,\E\=k 

Let Y,Z cA such that |y | = \Z\ = k. Observe that W{A, Y) n W{A, Z) 
is nonempty and apart from the initial assignment A this intersection may 
contain assignments which are modified only in the common vectors Y (1 Z. 
To calculate the size of the neighborhood of k-opt let us introduce W'{A, E) 
as a set of all assignments in E) such that every vector in E is modified 

in at least one dimension, where E (Z Ais the set of k selected vectors in the 
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assignment A: 

W'{A, E) = {A' G W{A, E): \A^A\=n-k]. 
Then the neighborhood A^A;-opt(^) of A;-opt is 

iVfc-opt(A)= U W\A,E) (4.11) 

EcA,\E\<k 

and since W{A, Y) n W{A, Z) = ii Y Z we have 

|iV,.opt(A)| = Yl = E (^)^^ (4-12) 

EcA,\E\<k i=0 ^ ^ 

where A^* = for any E with \E\ = i. Observe that 

W'{A,E) = W{A,E)\ [j W'{A,E') 

E'CE 

and E)| = fc!*"^ for \E\ = k and, hence, 

= k\'-^-J2( • )^'- (4-13) 
It is obvious that = 1 since one can obtain exactly one assignment (the 



given one) by changing no vectors. From this and (4.13) we have = 



= 2^-1 - 1 and A^^ = qs-i _ 3 . 2«-i + 2. From this and (4.12) follows 



\N,.o,M)\ = 1 + (^yr-' - 1) , (4.14) 

\Ns.oAA)\ = 1 + (2) (2^"' - 1) + (3) (6^"' - 3 ■ 2^-^ + 2) • (4.15) 

In our implementation, we skip an iteration if the corresponding set 
of vectors E either consists of the vectors of the minimal weight {w{e) = 
miuggx w{e) for every e G -E) or all these vectors have remained unchanged 
during the previous run of fc-opt. 
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It is assumed in the literature [71 [85], [93] that fc-opt for > 2 is too slow to 
be applied in practice. However, the neighborhood Nk-opt do not only includes 
the neighborhood A'"(,fc_i)_opt but also grows exponentially with the growth of 
k and, thus, becomes very powerful. We decided to include 2-opt and 3-opt in 
our research. Greater values of k are not considered in this research because 
of nonpractical time complexity (observe that the time complexity of 4-opt 
is 0{n^ ■ 24^^"^)) and even 3-opt with all the improvements described above 
still takes a lot of time to proceed. However, 3-opt is more robust when used 



in a combination with some other heuristic (see Section 4.4) 



It is worth noting that our extension of the pairwise (triple) interchange 
heuristic [7j is not typical. Many papers lU [161 EH ESI [93] consider another 
neighborhood: 

-^fc-opt*(^) = {pd{A, p) '■ -D C {1, 2, . . . , s}, |Z^| = 1 and p moves at most k elements} , 



where pd is defined in (4.2). The size of such neighborhood is |A''fc-opt*(^)| = 
s ■ (2) ■ {k\ — 1) + 1 and the time complexity of one run of fc-opt* in the 
assumption k <^nis 0{s ■n'' ■ k\), i.e., unlike fc-opt, it is not exponential with 
respect to the number of dimensions s which is considered to be important by 



many researchers. However, as it is stated in Section 1.2 , we assume that s is a 
small fixed constant and, thus, the time complexity of fc-opt is still reasonable. 
At the same time, observe that A''fc-opt*(^) C A''i_dv(A) for any k < n, i.e., 
IDV performs as good as n-opt* with the time complexity of 3-opt*. Only 
in the case of = 2 the heuristic 2-opt* is faster in theory however it is 
known [13] that the expected time complexity of AP is significantly less than 
0{n'^) and, thus, the running times of 2-opt* and IDV are similar while IDV 
is definitely more powerful. Because of this we do not consider 2-opt* in our 
comparison. 



4.3 Lin-Kernighan 

The Variable Depth Interchange (VDI) was first introduced by Balas and 
Saltzman for 3-AP as a local search based on the well-known Lin-Kernighan 
heuristic for the Traveling Salesman Problem [7] . We provide here a natural 
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extension v-opt of the VDI local search for the s-dimensional case, s > 3, and 
then improve this extension. Our computational experiments show that the 
improved version of v-opt is superior to the natural extension of VDI with 
respect to solution quality at the cost of a reasonable increase in running 
time. In what follows, v-opt refers to the improved version of the heuristic 
unless otherwise specified. 

In VDI is described quite briefly. Our contribution is not only in 
extending, improving and analyzing it but also in a more detailed and, we 
believe, clearer explanation of it. We describe the heuristic in a different way 
to the description provided in [7j, however, both versions of our algorithm 
are equal to VDI in case of s = 3. This fact was also checked by reproducing 
experimental results reported in [7]. 

In what follows we will use function U {u, v) which returns a set of swaps 
between the vectors u and v. The difference between two versions of v-opt is 
only in the U{u, v) definition. For the natural extension of VDI, let U {u, v) be 



a set of all the possible swaps (see (4.3)) in at most one dimension between 



the vectors u and v, where the coordinates in at most one dimension are 
swapped: 

U{u, v) = {swap{u, v,D) : D C {1,2, . . . , s} and \D\ < l] . 

For the improved version of v-opt, let U {u, v) be a set of all the possible 
swaps in at most \_s/2\ dimensions between the vectors v and w: 

U{u, v) = [swap{u, v,D) : D C {1,2, . . . , s} and \D\ < s/2] . 

The constraint \D\ < s/2 guarantees that at least half of the coordinates 
of every swap are equal to the first vector coordinates. The computational 
experiments show that removing this constraint increases the running time 
and decreases the average solution quality. 

Let vector fi{u, v) be the minimum weight swap between vectors u and v. 



fi{u,v) = aigmmw{e) 

e£U(u,v) 
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Let A be an initial assignment. 

1. For every vector c G A do the rest of the algorithm. 

2. Initialize the total gain G = 0, the best assignment Abest = A, and a 
set of available vectors L = A \ {c}. 

3. Find vector m & L such that w{fi{c,m)) is minimized. Set v = fi{c,m) 
and Vj = {cj,mj} \ {vj} for every 1 < j < s. Now v G U{c,m) is the 
minimum weight swap of c with some other vector m in the assignment, 
and V is the complementary vector. 

4. Set G = G + w{c) — w{v). If now G < 0, set A = Abest and go to the 
next iteration (Step[T]). 

5. Mark m as an unavailable for the further swaps: L = L \ {m}. Note 
that c is already marked unavailable: c ^ L. 

6. Replace m and c with v and v. Set c = v. 

7. If w{A) < w{A\^cst), save the new assignment as the best one: Abest = A. 

8. Repeat from Step [3] while the total gain is positive (see Step |4]) and 

The heuristic repeats until no improvement is found during a run. The 
time complexity of one run of v-opt is 0{n^ ■ 2^*"^). The time complexity of 
the natural extension of VDI is 0{n^ ■ s), and the computation experiments 
also show a significant difference between the running times of the improved 
and the natural extensions. However, the solution quality of the natural 
extension for s > 7 is quite poor, while for the smaller values of s it produces 
solutions similar to or even worse than sDV solutions at the cost of much 
larger running times. 

The neighborhood A^v-opt(^) is not fixed and depends on the MAP in- 
stance and initial assignment A. The number of iterations (runs of Step [3]) 
of the algorithm can vary from n to n^. Moreover, there is no guarantee that 
the algorithm selects a better assignment even if the corresponding swap is in 
U{c, m). Thus, we do not provide any results for the neighborhood of v-opt. 
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4.4 Variable Neighborhood Descend 

Above we have presented two types of neighborhoods, let us say dimension- 



wise (Section 4.1) and vector-wise (Sections |4.2 and 4.3). The idea of our 
combined heuristic is to use the dimensionwise and the vectorwise neigh- 
borhoods together, combining them into so called Variable Neighborhood 
Descent |99j . The combined heuristic improves the assignment by moving it 
into a local optimum with respect to the dimensionwise neighborhood, then 
it improves it by moving it to a local minimum with respect to the vectorwise 
neighborhood. The procedure is repeated until the assignment occurs in a 
local minimum with respect to both the dimensionwise and the vectorwise 
neighborhoods. 

More formally, the combined heuristic DVopt consists of a dimensionwise 
heuristic DV (either IDV, 2DV or sDV) and a vectorwise heuristic opt (either 
2-opt, 3-opt or v-opt). DVopt proceeds as follows: 

1. Apply the dimensionwise heuristic A = DV{A). 

2. Repeat: 

(a) Save the assignment weight x = w{A) and apply the vectorwise 
heuristic A = opt{A). 

(b) If w{A) = X stop the algorithm. 

(c) Save the assignment weight x = w{A) and apply the dimension- 
wise heuristic A = DV{A). 

(d) If w{A) = X stop the algorithm. 

Step [l] of the combined heuristic is the hardest one. Indeed, it is typical 
that it takes a lot of iterations to move a bad solution to a local minimum 
while for a good solution it takes just a few iterations. Hence, the first of the 
two heuristics should be the most efficient one, i.e., it should perform quickly 
and produce a good solution. In this case the dimensionwise heuristics are 
more efficient because, having approximately the same as vectorwise heuris- 
tics time complexity, they search much larger neighborhoods. The fact that 
the dimensionwise heuristics are more efficient than the vectorwise ones is 



also confirmed by experimental evaluation (see Section 4.6) 
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It is clear that the neighborhood of a combined heuristic is defined as 
follows: 

N^y^JA) = iVDv(A) U iV,pt(A) , (4.16) 

where A^dv(^) and Nopt{A.) are neighborhoods of the corresponding dimen- 
sionwise and vectorwise heuristics respectively. To calculate the size of the 
neighborhood A^oVopt (^) need to find the size of the intersection of these 
neighborhoods. Observe that 

NDy{A)nNi:.opt{A.) = [pd{A, p) : D E V and p moves at most k elements} , 

(4.17) 



where pd{A, p) is defined by (4.2). This means that, if is the number of 



permutations on n elements which move at most k elements, the intersection 



(4.17) has size 



\Nj,y{A) n Nk.opt{A)\ = \V\ . (rfc - 1) + 1 



(4.18) 



The number can be calculated as 



E 

i=0 



n 



di 



(4.19) 



where di is the number of derangements on i elements, i.e., permutations 
on i elements such that none of the elements appear on their places; di = 
^!-ELo(-1)'"M! n For = 2, = 1+Q); for = 3, rg = l+Q)+2g). 



From (|4.9|), (|4.12|), (|4.16|) and (|4.18|) we immediately have 

-|P|-(rfc-l), (4.20) 



Nj,y,_(A)=l + \V\.in\-l) + 



4 = 2 



n 



where A^* and are calculated according to (4.13) and (4.19) respectively. 
Substituting the value of k, we have: 



\N^Y,_^(A)\ = l + \V\.in\-l] 



n 



(2 



s-l 



1)-II?I- 



n 



and (4.21) 
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\Nuy,_^(A)\ = l + \V\-{n\-l) + 



n 



+ 1 3 ) (6'"' - 3 • r^^ 



2) - \V\ ■ 



n 



(4.22) 



One can easily substitute \V\ = s, \V\ = (l) and \V\ = 2'-^ - 1 to (4.21) 



or (4.22) to get the neighborhood sizes of IDV2, 2DV2, sDVs, IDV3, 2DV3 



and SDV3. We will only show the results for SDV2: 



iV,Dv.(A)| = 1 + (2^-^ - 1) ■ (n! - 1) + J (2-^ - 1) - (2 



n 



-,5-1 



1 + (2 



s-l 



r 



1), (4.23) 



i.e., |iV,DV2(^)l = \NsBv{A)\. Since N^BviA) C NsdyM) (see ( |4l6| ), we 
can conclude that NgYiy^^A) = Nsby{A). Indeed, the neighborhood of 2-opt 
can be defined as follows: 



2-opt 



{poiA, p) : D C {2, 3, . . . , s} and p swaps at most two elements} 



which is obviously a subset of A^sdv(^) (see (4.5)). Hence, the combined 
heuristic SDV2 is of no interest. 



For other combinations the intersection (4.17) is significantly smaller than 



both neighborhoods A^dv(^) and N^_^^^{A) (recall that the neighborhood 
^v-opt has a variable structure). Indeed, |A^dv(^)| ^ Wdy^A) r\ Nk-o-pt{,A)\ 
because \V\ ■ {n\ - 1) > \V\ ■ (r^ - 1) for k <^ n. Similarly, |A^2-opt(-4)| > 
\Nj,^{A) n Nk.opM)\ because {^^{2'-^ - 1) > \V\ ■ Q) if \V\ < 2^-^, which 
is the case for IDV and 2DV if s is large enough. Finally, |A'"3_opt(^)| 3> 
|iVDv(A) n iVfc_opt(A)| because (^)(2«-i - 1) + ©(e^^^ - 3 • V'^ + 2) > 
\V\ ■ [(2) + 2(3)], which is true even for \V\ = 2*"^ i.e., for sDV. 

The time complexity of the combined heuristic is 0{n^ ■ k\'^~^ + \V\ ■ n^) 
in case of opt = k-opt and 0(n^ • (2*^^ + \'D\)) if opt = v-opt. The particular 
formulas are provided in the following table: 
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2-opt 


3-opt 


v-opt 




IDV 


0(2^-1 ■n'^ + s-n^) 




0{2' ■ 


n^) 


2DV 






0{2' ■ 




sDV 


(no interest) 


0{6'-^ ■ n^) 


0{2' ■ 





Note that all the combinations with 3-opt and v-opt have equal time 
complexities; this is because the time complexities of 3-opt and v-opt are 
dominant. Our experiments show that the actual running times of 3-opt and 
v-opt are really much higher then even the sDV running time. This means 
that the combinations of these heuristics with sDV are approximately as fast 
as the combinations of these heuristics with light dimensionwise heuristics 
IDV and 2DV. Moreover, as it was noticed above in this section, the dimen- 
sionwise heuristic, being executed first, simplifies the job for the vectorwise 
heuristic and, hence, the increase of the dimensionwise heuristic power may 
decrease the running time of the whole combined heuristic. At the same time, 
the neighborhoods of the combinations with sDV are significantly larger than 
the neighborhoods of the combinations with IDV and 2DV. We can conclude 
that the 'light' heuristics IDV3, 2DV3, IDVv and 2DVv are of no interest 
because the 'heavy' heuristics SDV3 and sDVy, having the same theoretical 
time complexity, are more powerful and, moreover, outperformed the 'light' 
heuristics in our experiments with respect to both solution quality and run- 
ning time on average and in most of single experiments. 



4.5 Other Algorithms 

Here we provide a list of some other MAP algorithms presented in the liter- 
ature. 

• A host of local search procedures and construction heuristics which 
often have some approximation guarantee ([8l [151 [El ISH [ZOl [ZZ] and 

some others) are proposed for several special cases of MAP (usually 



with decomposable weights, see Section 2.1.2) and exploit the specifics 
of these instances. However, as it was stated in Section [L2l we consider 
only the general case of MAP, i.e., all the algorithms included in this 
research do not rely on any special structure of the weight matrix. 
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A number of construction heuristics are intended to generate solutions 



for the general case of MAP, see Section 2.5.1 While some of them 
are fast and low quality, like Greedy, some, like Max- Reg ret, are signifi- 
cantly slower but produce much better solutions. A special class of con- 
struction heuristics. Greedy Randomized Adaptive Search Procedure 
(GRASP), was also investigated by many researchers [H |77l EH 193] . 



Several metaheuristics, including a simulated annealing procedure [16] 
and a memetic algorithm [S2], were proposed in the literature. Meta- 
heuristics are sophisticated algorithms intended to search for the near 
optimal solutions in a reasonably large time. Proceeding for much 
longer than local search and being hard for theoretical analysis of the 
running time or the neighborhood, metaheuristics cannot be compared 
straightforwardly to local search procedures. 

Some weak variations of 2-opt are considered in [H [771 ESI [93]. While 
our heuristic 2-opt tries all possible recombinations of a pair of as- 
signment vectors, i.e., 2'^^^ combinations, these variations only try the 
swaps in one dimension at a time, i.e., s combinations for every pair of 
vectors. We have already decided that these variations have no practi- 



cal interest, for details see Section 4.2 



4.6 Experiment Results 

In this section, the results of empirical evaluation are reported and discussed. 



In our experiments we use the instance families discussed in Section 2A The 
sizes of all but GP instances are selected such that an algorithm could process 
them all in approximately the same time. The GP instances are included in 
order to examine the behavior of the heuristics on smaller instances (recall 
that GP is the only instance set for which we know the exact solutions for 
small instances). 

All the heuristics are implemented in Visual C++. The evaluation plat- 
form is based on AMD Athlon 64 X2 3.0 GHz processor. 

We present the results of three different types of experiments: 
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In Subsection 4.6.1[ the local search heuristics are applied to the assign- 



ments generated by some construction heuristic. These experiments 
allow us to exclude several local searches from the rest of the experi- 
ments. However, the comparison of the results is complicated because 
of the significant difference in both the solution quality and the running 
time. 



In Subsection |4.6.2[ two simple metaheuristics are used to equate the 
running times of different heuristics. This is done by varying of number 
of iterations of the metaheuristics. 



• In Subsection |4.6.3[ the results of all the discussed approaches are gath- 
ered in two tables to find the most successful solvers for the instances 
with independent and decomposable weights for every particular run- 
ning time. 

4.6.1 Pure Local Search Experiments 

In this section, we run every local search heuristic for every instance exactly 
once. The local search is applied to a solution generated with one of the 



following construction heuristics (for details see Section 2.5.1): 

1. Trivial, which was first mentioned in [7] as Diagonal. Trivial construc- 
tion heuristic simply assigns A* = i for every i = l,2,...,n and 
j = l,2,...,s. 

2. Greedy was discussed in many papers, see, e.g. [H [TSl ESI ESI SO]- It 
was proven [35] that in the worst case Greedy produces the unique worst 
solution; however, it was shown |36] that in some cases Greedy may be 
a good selection as a fast and simple heuristic. 

3. Max-Regret was discussed in a number of papers, see, e.g., [3 [T51 E51 
|93] . As for Greedy, it is proven [35] that in the worst case Max-Regret 
produces the unique worst solution however many researchers [7] noted 
that Max-Regret is quite powerful in practice. 



4. 



ROM was first introduced in [35j as a heuristic of a large domination 
number. 
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We use the improved versions of the construction heuristics, see Sec- 
tion [2331 

We will begin our discussion from the experiments started from trivial 
assignments. Recall that our test bed includes 10 instances of every size and 



type and, hence, every result reported in Tables A. 18 and A. 19 is an average 
for 10 experiments, one experiment for each instance. Each table is split 
into two parts; the first part contains only the instances with independent 
weights (GP and Random) while the second part contains only the instances 
with decomposable weights (Clique, Geometric, Product and SquareRoot). The 
average values for different instance families and numbers of dimensions are 
provided at the bottom of each part of each table. The tables are also split 
vertically according to the classes of heuristics. The winner in every row and 
every class of heuristics is underlined. 

The value of the solution error is calculated as I — — ; — 1 I ■ 100%, 

where A is the obtained assignment and Abest is the optimal assignment (or 



the best known one, see Section 2.1) 



In the group of the vectorwise heuristics the most powerful one is defi- 
nitely 3-opt. v-opt outperforms it only in a few experiments, mostly three 
dimensional ones (recall that the neighborhood of fc-opt increases exponen- 
tially with the increase of the number of dimensions s). As it was expected, 
2-opt never outperforms 3-opt since Ai'2_opt C A^s-opt (see Section 4.2). The 



tendencies for the independent weight instances and for the decomposable 
weight instances are similar; the only difference which is worth to note is 
that all but v-opt heuristics of this group solve the Product instances very 
well. Note that the dispersion of the weights in Product instances is really 
high and, thus, v-opt, which minimizes the weight of only one vector in every 
pair of vectors while the weight of the complementary vector may increase 
arbitrary, cannot be efficient for them. 

As one can expect, sDV is more successful than 2DV and 2DV is more 
successful than IDV with respect to the solution quality (obviously, all the 
heuristics of this group perform equally for 3-AP and 2DV and sDV are also 



equal for 4-AP, see Section 4.1). However, for the instances with decompos- 



able weights all the dimensionwise heuristics perform very similarly and even 
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for the large s, sDV is not significantly more powerful than IDV or 2DV which 
means that in case of decomposable instances the most efficient iterations are 
when \D\ = 1. We can assume that if c is the number of edges connecting the 
fixed and unfixed parts of the clique, then an iteration of a dimensionwise 
heuristic is rather efficient when c is small. Observe that, e.g., for Clique the 



diversity of values in the weight matrix [Mij]nxn (see (4.4)) decreases with 
the increase of the number c and, hence, the space for optimization on every 
iteration is decreasing. Observe also that in the case c = 1 the iteration leads 
to the optimal match between the fixed and unfixed parts of the assignment 
vectors. 

All the combined heuristics show improvements in the solution quality 
over each of their components, i.e., over both corresponding vectorswise and 
dimensionwise local searches. In particular, IDV2 outperforms both 2-opt 
and IDV, 2DV2 outperforms both 2-opt and 2DV, SDV3 outperforms both 
3-opt and sDV and sDVy outperforms both v-opt and sDV. Moreover, sDVs 
is significantly faster than 3-opt and sDVv is significantly faster than v-opt. 
Hence, we will not discuss the single heuristics 3-opt and v-opt in the rest of 
the chapter. The heuristics IDV2 and 2DV2, obviously, perform equally for 
3-AP instances. 

While for the instances with independent weights the combination of the 
dimensionwise heuristics with the vectorwise ones significantly improves the 
solution quality, it is not the case for the instances with decomposable weights 
(observe that IDV performs almost as well as the most powerful heuristic 
SDV3) which shows the importance of the instances division. We conclude 
that the vectorwise neighborhoods are not efficient for the instances with 
decomposable weights. 

Next we conducted the experiments starting from the other construction 
heuristics. But first we compared the construction heuristics themselves, see 
Table \KA7\ It is not surprising that Trivial produces the worst solutions. 
However, one can see that Trivial outperforms Greedy and Max-Regret for 
every Product instance. The reason is in the extremely high dispersion of the 
weights in Product. Both Greedy and Max-Regret construct the assignments 
by adding new vectors to it. The decision which vector should be added does 
not depend (or does not depend enough in case of Max-Regret) on the rest 
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of the vectors and, thus, at the end of the procedure only the vectors with 
huge weights are available. For other instance families. Greedy, Max-Regret 
and ROM perform similarly though the running time of the heuristics is very 
different. Max-Regret is definitely the slowest construction heuristic; Greedy 
is very fast for the Random instances (this is because of the large number of 



vectors of the weight a and the implementation features, see Section 2.5.3 



for details) and relatively slow for the rest of the instances; ROM's running 
time almost does not depend on the instance and is constantly moderate. 



Starting from Greedy (Table A. 20) significantly improves the solution 
quality. This mostly influenced the weakest heuristics, e.g., 2-opt average 
error decreased in our experiments from 59% and 20% to 15% and 6% for 
independent and decomposable weights respectively, though, e.g., the most 
powerful heuristic SDV3 error also noticeably decreased (from 2.8% and 5.8% 
to 2.0% and 2.5%). As regards the running time. Greedy is slower than most 
of the local search heuristics and, thus, the running times of all but sDVs 
and sDVv heuristics are very similar. The best of the rest of the heuristics 
in this experiment is sDV though IDV2 and 2DV2 perform similarly. 

Starting from Max-Regret improves the solution quality even more but 
at the cost of very large running times. In this case the difference in the 
running time of the local search heuristics almost disappears and SDV3, the 
best one, reaches the average error values 1.3% and 2.2% for independent 
and decomposable weights respectively. Starting from ROM improves the 
quality only for the worst heuristics. This is probably because all the best 
heuristics contain sDV which does a good vectorwise optimization (recall 
that ROM exploits a similar to the dimensionwise neighborhood idea). At 
the same time, starting from ROM increases the running time of the heuristics 
significantly; the results for both Max-Regret and ROM are excluded from this 
work; one can find them on the web [57] . 

It is clear that the construction heuristics are quite slow comparing to 
the local search]^ and we should answer the following question: is it worth 



^Note that a basic construction heuristic is normally faster that a local search proce- 
dure. However, a typical MAP instance has a huge weight matrix [n'^ elements), and every 
of the considered construction heuristics scans this matrix at least once which takes 0{n^) 
operations. In contrast, exploration of a local search neighborhood may be relatively quick 
like 0(n*2'*) or 0{n?s) operations for the 2-opt and IDV heuristics, respectively. 
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to spend so much time on the initial solution construction or there is some 
way to apply local search several times in order to improve the assignments 
iteratively? It is known that the algorithms which apply local search several 
times are called metaheuristics. There is a number of different metaheuristic 
approaches such as tabu search or memetic algorithms, but this is not the 
subject of this research. In what follows, we are going to use two simple 
metaheuristics. Chain and Multichain. 

4.6.2 Experiments With Metaheuristics 

It is obvious that there is no sense in applying a local search procedure to one 
solution several times because a local search moves the solution to a local 
minimum with respect to its neighborhood, i.e., the second exploration of 
this neighborhood is useless. In order to apply a local search several times, 
one should perturb the solution obtained on the previous iteration. This idea 
immediately brings us to the first metaheuristic, let us say Chain: 

1. Initialize an assignment A; 

2. Set Abest = A; 

3. Repeat: 

(a) Apply local search A = LS{A); 

(b) If w{A) < w(Aest) set Aest = A; 

(c) Perturb the assignment A — Perturb{A). 

In this algorithm we use two subroutines, LS{A) and Perturb{A). The 
first one is some local search procedure and the second one is an algorithm 
which moves the given assignment away from the local minimum by a random 
perturbation of it. The perturbation should be strong enough such that the 
assignment will not come back to the previous position on the next iteration 
every time though it should not be too strong such that the results of the 
previous search would be totally destroyed. Our perturbation procedure 
selects p = [n/25] + 1 vectors in the assignment and perturbs them randomly. 
In other words, Perturb{A) is just a random move of the p-opt heuristic. The 
parameters of the procedure are obtained empirically. 
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One can doubt if Chain is good enough for large running times and, thus, 
we introduce a little bit more sophisticated metaheuristic. Multichain. Unlike 
Chain, Multichain maintains several assignments on every iteration: 

1. Initialize assignment Abest; 

2. Set P = and repeat the following c(c + l)/2 times: 
P = PU{LSiPerturbiA^,,t))} 

(recall that Perturh{A) produces a different assignment every time); 

3. Repeat: 

(a) Save the best c assignments from P into Ci, C2, . . . , Cc such that 

(b) If w{Ci) < lt;(Cbest) set Abest = Ci. 

(c) Set P = and for every i = 1,2, . . . ,c repeat the following c—i + 1 
times: P = PU {LS{Perturb{Ci))}. 

The parameter c is responsible for the power of Multichain; we use c = 5 
and, thus, the algorithm performs c(c + l)/2 = 15 local searches on every 
iteration. 

The results of the experiments with Chain running for 5 and 10 seconds 
are provided in Tables A. 21 and A.22| respectively. The experiments are 



repeated for three construction heuristics. Trivial, Greedy and ROM. It was 
not possible to include Max- Regret in the comparison because it takes much 
more than 10 seconds for some of the instances. 

The diversity in solution quality of the heuristics decreased with the us- 
age of a metaheuristic. This is because the fast heuristics are able to repeat 
more times than the slow ones. Note that SDV3, which is the most pow- 
erful single heuristic, is now outperformed by other heuristics. The most 
successful heuristics for the instances with independent and decomposable 
weights are sDVy and IDV respectfully, though IDV2 and 2DV2 are slightly 
more successful than sDVy for the GP instances. This result also holds for 



Multichain, see Tables [A.23| and |A.24[ The success of IDV confirms again 



that a dimensionwise heuristic is most successful when |D| = 1 if the weights 
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are decomposable and that it is more efficient to repeat these iterations many 
times rather than try \D\ > 1. For the explanation of this phenomenon see 
Section 4.6.1 The success of IDV2 and 2DV2 for GP means existence of a 
certain structure in the weight matrices of these instances. 

One can see that the initialization of the assignment is not crucial for 
the final solution quality. However, using Greedy instead of Trivial clearly 
improves the solutions for almost every instance and local search heuristic. 
In contrast to Greedy, using of ROM usually does not improve the solution 
quality. It only influences 2-opt which is the only pure vectorwise local search 
in the comparison (recall that ROM has a dimensionwise structure and, thus, 
it is good in combination with vectorwise heuristics). 

The Multichain metaheuristic, given the same time, obtains better results 
than Chain. However, Multichain fails for some combinations of slow local 
search and hard instance because it is not able to complete even the first 
iteration in the given time. Chain, having much easier iterations, do not have 
this disadvantage. 

Giving more time to a metaheuristic also improves the solution quality. 
Therefore, one is able to obtain high quality solutions using metaheuristics 
with large running times. 

4.6.3 Solvers Comparison 

To compare all the heuristics and metaheuristics discussed in this research 



we use the same technique as in Section 3.5.5 The results are presented 
in Tables IA.25I and IA.26[ These tables indicate which heuristics should be 
chosen to solve particular instances in the given time limitations. Several best 
heuristics are selected for every combination of the instance and the given 
time. A heuristic is included in the table if it was able to solve the problem 
in the given time, and if its solution quality is not worse than 1.1 ■ tu(y4best) 
and its running time is not larger than 1.1 ■ tbest, where Abest is the best 
assignment produced by the considered heuristics and tbest is the time spent 
to produce v4best- 



The following information is provided for every solver in Tables A. 25 
andlAiSni 
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• Metaheuristic type (C for Chain, MC for Multichain or empty if the 
experiment is single). 

• Local search procedure (2-opt, IDV, 2DV, sDV, IDV2, 2DV2, SDV3 sDVv 
or empty if no local search was applied to the initial solution). 

• Construction heuristic the experiment was started with (Gr, M-R or 
empty if the assignment was initialized by Trivial). 

• The solution error in percent. 

The following solvers were included in this experiment: 

• Construction heuristics Greedy, Max-Regret and ROM. 

• Single heuristics 2-opt, IDV, 2DV, sDV, IDV2, 2DV2, sDVa and sDV^started 
from either Trivial, Greedy, Max-Regret or ROM. 

• Chain and Multichain metaheuristics for either 2-opt, IDV, 2DV, sDV, 
IDV2, 2DV2, SDV3 or sDVy and started from either Trivial, Greedy, Max- 
Regret or ROM. The metaheuristics proceeded until the given time 
limitations. 

Note that for certain instances we exclude duplicating solvers (recall that 
all the dimensionwise heuristics perform equally for 3-AP as well as 2DV and 



sDV perform equally for 4-AP, see Section 4.1). The common rule is that we 
leave sDV rather than 2DV and 2DV rather than IDV. For example, if the list 
of successful solvers for some 3-AP instance contains C IDV Gr, C 2DV Gr 
and C sDV Gr, then only C sDV Gr will be included in the table. This is 
also applicable to the combined heuristics, e.g, having IDV2 R and 2DV2 R 
for a 3-AP instance, we include only 2DV2 R in the final results. 

The last row in every table indicates the heuristics which are the most 
successful on average, i.e., the heuristics which can solve all the instances 
with the best average results. 

Single construction heuristics are not presented in the tables; single local 
search procedures appear only for the small allowed times when all other 
heuristics take more time to run; the most of the best solvers are the meta- 
heuristics. Multichain seems to be more suitable than Chain for large running 
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times; however, Multichain does not appear for the instances with small n. 
This is probably because the power of the perturbation degree increases with 
the decrease of the instance size (note that perturb{A) perturbs at least two 
vectors in spite of n). 

The most successful heuristics for the assignment initialization are Trivial 
and Greedy; Trivial is useful rather for small running times. Max-Regret and 
ROM appear only a few times in the tables. 

The success of a local search depends on the instance type. The most 
successful local search heuristic for the instances with independent weights is 
definitely sDVy. The sDV heuristic also appears several times in Table A.25[ 
especially for small running times. For the instances with decomposable 
weights, the most successful are the dimensionwise heuristics and, in partic- 
ular, IDV. 



4.7 Conclusion 

Several neighborhoods are generalized and discussed in this chapter. An effi- 
cient approach of joining different neighborhoods is successfully applied; the 
yielded heuristics showed that they combine the strengths of their compo- 
nents. The experimental evaluation for a set of instances of different types 
show that there are several superior heuristic approaches suitable for different 
kinds of instances and running times. Two kinds of instances are selected: in- 
stances with independent weights and instances with decomposable weights. 
The first ones are better solvable by a combined heuristic sDVy; the second 
ones are better solvable by IDV. In both cases, it is good to initialize the 
assignment with the Greedy construction heuristic if there is enough time; 
otherwise one should use a trivial assignment as the initial one. The results 
can also be significantly improved by applying metaheuristic approaches for 
as long as possible. 

Thereby, it is shown in this chapter that the metaheuristic approach, 
being based on the fast local search, dominates slow heuristics and, thus, 
further research of some more sophisticated metaheuristics such as memetic 
algorithms is of interest. 
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Chapter 5 

Memetic Algorithms 



A memetic algorithm (AM) is a combination of an evolutionary algorithm 
with a local search procedure |171 ES] • The memetic approach is a template 
for an algorithm rather than a set of rules for designing a powerful heuristic. 



A typical frame of MA is presented in Figure 5.1 (for a formal definition of 
a MA main loop see, e.g., [U7]). 

1. Produce the first generation, i.e., a set of feasible solutions. 

2. Apply a local search procedure to every solution in the first generation. 

3. Repeat the following while a termination criterion is not met: 

(a) Produce a set of new solutions by applying so-called genetic op- 
erators to solutions from the previous generation. 

(b) Improve every solution in this set with the local search procedure. 

(c) Select several best solutions from this set to the next generation. 

Figure 5.1: A typical memetic algorithm frame. 

After a thorough research of GTSP and MAP local search, we can use 
our knowledge to design MAs for these problems. However, the development 
of the GTSP local search preceded our research of GTSP MA and, thus, in 
Section 5A_ we do not use some of the improvements proposed in Section |3| It 



is in our future plans to update our GTSP MA according to the most recent 



results. Nevertheless, the algorithm presented in Section 5.1 is the state-of 
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the-art GTSP metaheuristic. It clearly dominates all other metaheuristics 
known from the literature. Moreover, it outperforms all the algorithms fl2\ 
llUUj appeared after our results were published. 



5.1 GTSP Memetic Algorithm 

We start with a general scheme of our heuristic, which is similar to the general 



schemes of many memetic algorithms, see Figure 5.1 



Step 1 Initialize. Construct the first generation of solutions. To produce a 



solution we use a semirandom construction heuristic (see Section 5.1.2 ) 



Step 2 Improve. Use a local search procedure to replace each of the first 
generation solutions by a local optimum. Eliminate duplicate solutions. 

Step 3 Produce next generation. Use reproduction, crossover, and mutation 
genetic operators to produce the non-optimized next generation. Each 
of the genetic operators selects parent solutions from the previous gen- 
eration. The weight of a solution is used as the evaluation function. 

Step 4 Improve next generation. Use a local search procedure to replace each 
of the current generation solutions except the reproduced ones by the 
local optimum. Eliminate duplicate solutions. 

Step 5 Evolute. Repeat Steps 3-4 until a termination condition is reached. 



5.1.1 Coding 

MA requires each solution to be coded in a chromosome, i.e., to be repre- 
sented by a sequence of genes. Unlike [HSl 1101] we use a natural coding of 
the solutions as in [95j. The coded solution is a sequence of numbers (Ti 
T2 . . . Tm) such that Ti is the vertex at the position i of the solution. For 
example (2 5 9 4) represents the cycle visiting vertex 2, then vertex 5, then 
vertex 9, then vertex 4, and then returning to vertex 2. Note that not any 
sequence corresponds to a feasible solution as the feasible solution should 
contain exactly one vertex from each cluster, i.e., Cluster{Ti) 7^ Cluster {Tj) 
for any i ^ j. 
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Note that, using natural coding, each solution can be represented by m 
different chromosomes: the sequence can be 'rotated', i.e., the first gene can 
be moved to the end of the chromosome or the last gene can be inserted be- 
fore the first one and these operations will preserve the cycle. For example, 
chromosomes (2 5 9 4) and (5 9 4 2) represent the same solution. We need 
to take this into account when considering several solutions together, i.e., 
in exactly two cases: when we compare two solutions, and when we apply 
crossover operator. In these cases we 'normalise' the chromosomes by rotat- 
ing each of them such that the vertex v ^ Vi (the vertex that represents the 
cluster 1) takes the first place in the chromosome. For example, if we had 
a chromosome (2 5 9 4) and the vertex 5 belongs to the cluster 1, then we 
rotate the chromosome in the following way: (5 9 4 2). 

In the case of the symmetric problem the chromosome can also be 're- 
flected' while preserving the solution. However, our heuristic is designed 
for both symmetric and asymmetric instances and, thus, the chromosomes 
(1 5 9 4) and (4 9 5 1) are considered as the chromosomes corresponding to 
distinct solutions. 

The main advantage of the natural coding is its efficiency in local search 
implementation^ Since the local search is the most time consuming part of 
our heuristic, the coding should be optimized for it. 

5.1.2 First Generation 

We produce 2m solutions for the first generation, where m is the number of 
clusters. The solutions are generated by a semirandom construction heuristic. 
The semirandom construction heuristic generates a random cluster permu- 
tation and then finds the best vertex in each cluster by applying the Cluster 



Optimization, see Section 3.1). 

The advantages of the semirandom construction heuristic are that it is fast 
and its cycles have no regularity. The latter is important as each completely 
deterministic heuristic can cause solutions uniformity and as a result some 
areas of solution space may not be explored. 

^Recall that this resuh was obtained before our thorough research of GTSP local search; 
also observe that the natural coding is efficient for the Basic adaptations of TSP neigh- 
borhoods, see Section [3j 
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5.1.3 Next Generations 

Each generation except the first one is based on the previous generation. To 
produce the next generation one uses genetic operators, which are algorithms 
that construct a solution or two from one or two so-called parent solutions. 
Parent solutions are chosen from the previous generation using some selection 
strategy. We perform r runs of reproduction, 8r runs of crossover, and 2r runs 
of mutation operator. The value r is calculated as 



r = 0.2c/ + 0.05m + 10 , (5.1) 

where g is the number of generations produced before the current one. As a 
result, we obtain at most llr solutions in each generation but the first one 
(note that we remove duplicate solutions from the population and, hence, 
the number of solutions in each generation may vary). 

One may expect the number of local minima found by the algorithm to 
increase from generation to generation. This number may also be expected 
to grow when the number of clusters m grows. Thus, in the formula above r 
depends on both g and m. All the coefficients in this section were obtained 
empirically. Note that slight variations in selection of these coefficients do 
not significantly influence the results of the algorithm. 



5.1.4 Reproduction 

Reproduction is a process of copying solutions from the previous generation. 
Reproduction operator requires a selection strategy. In our algorithm, we 



select r (see (5.1)) lightest solutions from the previous generation to copy 
them to the current generation. 



5.1.5 Crossover 

A crossover operator is a genetic operator that combines two different solu- 
tions from the previous generation. We use a modiflcation of the two-point 
crossover introduced by Silberholz and Golden [95] as an extension of an Or- 
dered Crossover [20j. Our crossover operator produces just one child solution 
(ri r2 . . . r^) from the parent solutions (pi P2 ■ ■ ■ Vm) and (gi q2 ■ ■ ■ qm)- At 
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first, it selects a random position a and a random fragment length 1 < I < m 
and copies the fragment [a, a + I) of the first parent to the beginning of the 
child solution: rj = pi^a for each i = 0,l,...,/ — ij^ To produce the rest of 
the child solution, we introduce a sequence q' as follows: q'^ = qi+a+i~i, where 
i = 1,2, ... ,m. Then, for every i, we remove q'^ if the cluster Cluster{q'^ 
is already visited by the child solution r. As a result, / vertices are re- 
moved: \q'\ = m — I. We extend the child solution r by the sequence q': 
r = (n rs ... n q'l q'2 ■ ■ ■ iL^i)- 

The main advantage of this crossover is that it tends to preserve the 
vertex order of both parents. 

Crossover example. Let the first parent p be (123456 7) and the second 
parent q = (3 25761 4) (for simplicity, we assume that every cluster 
contains exactly one vertex: Vi = {i}). First of all, we rotate the parent 
solutions such that Cluster{pi) = Cluster{qi) = 1: 
p = {1 23456 7) (remains the same) and 
g = (1 4 3 2 5 7 6). 

Then we choose a random fragment in the parent solutions: 
p = (1 2 3 4 5 6 7) 
g = (1 4 3 2 5 7 6) 

and copy this fragment from the first parent p to the child solution: r = (3 4). 
Next we produce the sequence g' = (5 7 6 1 4 3 2) and remove vertices 3 and 4 
from it as the corresponding clusters are already visited by r: g' = (5 7 6 1 2). 
Finally, we extend the child solution r by g': 
r = (3 4 5 7 6 1 2). 

The crossover operator requires some strategy to select two parent so- 
lutions from the previous generation. In our algorithm an elitist strategy 
is used; the parents are chosen randomly between the best 33% of all the 
solutions in the previous generation. 

^We assume that T^+m — Ti for the solution (Ti T2 . . . Tm) and for any 1 < i < m. 
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5.1.6 Mutation 

A mutation operator partially modifies a solution from the previous genera- 
tion. The modification should be stochastic and usually worsens the solution. 
The goal of mutation is to increase the solution diversity. 

Our mutation operator removes a random fragment of the solution and in- 
serts it at some random position. The size of the fragment is selected between 
0.05m and 0.3m. An elitist strategy is used in our algorithm; the parent is 
selected randomly among 75% best solutions in the previous generation. 

Mutation example. Let the parent solution be (1 2 3 4 5 6 7). Let the random 
fragment start at the position 2 and be of length 3. The new fragment 
position is 3, for example. After removing the fragment, we get (1 5 6 7). 
Now insert the fragment (2 3 4) at the position 3: (1 5 2 3 4 6 7). 

5.1.7 Termination condition 

For the termination condition we use the concept of idle generations. We call 
a generation idle if its best solution has the same weight as the weight of the 
best solution in the preceding generation. In other words, if some generation 
has not improved the solution, it is called idle. Our MA stops if a certain 
number of idle generations are produced sequentially. 

In particular, we implemented the following new condition. Let /(/) be the 
number of sequential idle generations with the best solution of the weight /. 
Let Icur = I{lcur)i where Icur is the weight of the best solution obtained so far. 
Let Imax = max /(/). Then our heuristic stops if Icur > niax{1.5/maa;, 0.05m-|- 

i>i cur 

5}. This formula means that we are ready to wait for the next improvement 
1.5 times more generations than we have ever waited previously. The constant 
0.05m -t- 5 is the minimum boundary for the number of generations we are 
ready to wait for improvement. 

All the coefficients used in this section are obtained empirically. 

5.1.8 Asymmetric instances 

Our algorithm is designed to process both symmetric and asymmetric in- 
stances, however, some parameters should take different values for these 
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types of instances for the purpose of high efficiency. In particular, we dou- 



ble the size of the first generation (4m instead of 2m, see Section 5.1.2) 



and increase the minimum number of idle generations by 5 (i.e., Icur ^ 



max{1.5/maa;, 0.05m + 10}, see Section 5.1.7). The local improvement pro- 
cedure (see below) has also some differences for symmetric and asymmetric 
instances. 

5.1.9 Local Improvement Part 

We apply a local improvement procedure for each solution added to the cur- 
rent generation. The local improvement procedure runs several local search 
heuristics sequentially. The following local search heuristics are used in our 
algorithm: 

• Swap tries to swap every non-neighboring pair of vertices, see Sec- 
tion |3.2.9 The heuristic applies all the improvements found during 



one cycle of swaps. 

k-Neighbor Swap is a naive implementation of the Fragment Optimiza- 



tion local search (see Section 3.4). It tries different permutations of 
every solution subsequence (Tj Tj+i . . . Tj+fc_i). In particular, it tries 
all the non-trivial permutations which are not covered by any of k'- 
Neighbor Swap, k' = 2,3, . . . , k — 1. For each permutation, the best 
vertex selection within the considered cluster subsequence is calculated. 
The best permutation is accepted if it improves the solution. The 
heuristic applies all the improvements found during one cycle. 



2-opt (see the Basic adaptation of 2-opt TSP neighborhood. Section 3.2.6 ) 
tries to replace every non-adjacent pair of edges Tj — )■ Tj+i and Tj — >■ 
Tj+i in the solution by the edges Tj — Tj and Tj+i — )■ Tj+i if the new 
edges are lighter, i.e., the sum of their weights is smaller than the sum 
of the weights of old edges. The heuristic applies all the improvements 
found during one cycle. 

Direct 2-opt is a modification of the 2-opt heuristic. It only considers 
long edges in the tour, i.e., it selects the edges Tj Tj+i and Tj — )• Tj+i 
from a list of the the heaviest edges in the tour. 
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Insertion (see the Local adaptation IhSl in Section 3.2.8) tries to remove 
a vertex from the solution and to insert it in a different position. The 
best vertex in the inserted cluster is selected after the insertion. The 
heuristic tries every combination of the old and the new positions except 
the neighboring positions, and applies all the improvements found. 

Cluster Optimization (CO) is exactly the same algorithm as described 



in Section 3.1 However, this implementation does not use all the im- 



provements proposed in Section |3.1.1 



For each local search algorithm with some local cluster optimization, i.e., 
for fc-Neighbor Swap and Insert, we use a speed-up heuristic. We calculate a 
lower bound /new of the new solution weight and compare it to the previous 
weight /prev of the solution before the move. If /new > /prev, the solution 
modification is immediately declined. The lower bound /new is calculated 
in the assumption that every new edge x — )■ ?/ in the tour has the weight 
Wmm{X — > y) of the shortest edge between the corresponding clusters X = 
Cluster{x) and Y = Cluster{y). 

Some of these heuristics form a heuristic-vector "H as follows: 

Symmetric instances Asymmetric instances 

Insert Swap 

Direct 2-opt for m/4 longest edges Insert 

2-opt Direct 2-opt for m/4 longest edges 

2- Neighbor Swap 2-opt 

3- Neighbor Swap 2-Neighbor Swap 

4- Neighbor Swap 3-Neighbor Swap 



The improvement procedure applies all the local search heuristics from 
Ti cyclically. Once some heuristic fails to improve the tour, it is excluded 
from "H. If 2-opt heuristic fails, we also exclude Direct 2-opt from "H. Once 
H is empty, the CO heuristic is applied to the solution and the improvement 
procedure stops. 
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5.1.10 Modification of the Algorithm for Preprocess- 
ing 



Recall that in Section |2.4| we proposed two reduction algorithms intended to 
reduce the size of a GTSP instance. The first algorithm removes some vertices 
and, hence, does not significantly change the structure of the instance. In 
contrast, the second algorithm removes some edges or, to be precise, sets 
some weights to a very large number. Observe that, if an edge of a very 
large weight is occasionally included in a tour, this may totally change the 
algorithm's behavior. 

For the purpose of evaluating the reduction algorithms, we modified our 
GTSP memetic algorithm (GK) as follows: 

• The 2-opt heuristic was extended with the cluster optimization (see 



2-optL adaptation in Section 3.2.6). 



Direct 2-opt heuristic was excluded from the Local Search Procedure. 

Every time before starting the Cluster Optimization, we remove all the 
vertices that cannot be included in the solution. In other words, a 
vertex y E Y is excluded if Wmm{X — t- y) = oo or Wmin(y Z) = oo, 
where X = Cluster (Ti), Y = Cluster (Ti^i) and Z = Cluster (Ti^2)- 

Since the modified Local Search Procedure is more powerful than the 
previous one, we reduced the number of solutions in a generation (see 



Section 5.1.3): r = 0.2g + 0.03m + 8. We have also changed the termi- 



nation condition (see Section 5.1.7): /cur > max(1.5/max7 0.025m + 2). 



5.2 Experimental Evaluation of GTSP Memetic 
Algorithm 



Our test bed includes all the instances described in Section |2.3| with 40 < 
m < 217. Unlike in PS | flOlj . smaller instances are not considered. 



Tables [A.27[ |A.28] and [X.29| report the experiments results. We compare 



the following heuristics: 
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GK is our GTSP memetic algorithm. 

SG is the heuristic by Silberholz and Golden |95j . 

SD is the heuristic by Snyder and Daskin PB] . 

TSP is the heuristic by Tasgetiren, Suganthan, and Pan |101] . 

The results for GK (our memetic algorithm) and SD were obtained in our 
own experiments. Other results are taken from the corresponding papers. 
Each result for GK and SD is averaged for ten algorithm runs (recall that all 
these heuristics are non-deterministic and, hence, their results may very from 
time to time). The results for SG and TSP were collected after five runs. 

To compare the running times of all the considered heuristics we need to 
convert the running times of SG and TSP obtained from the corresponding 
papers to the running times on our evaluation platform. Let us assume that 
the running time of some Java implemented algorithm on the SG evaluation 
platform is tsG = ^sg'^^gk, where /csc is some constant and tcK is the running 
time of the same but C++ implemented algorithm on our evaluation platform. 
Similarly, let us assume that the running time of some algorithm on the TSP 
evaluation platform is txsp = ^tsp " tcK- 

The computer used for GK and SD evaluation is based on AMD Athlon 
64 X2 3.0 GHz processor. The evaluation platforms used for SG and TSP are 
based on Intel Pentium 4 3.0 GHz and Intel Centrino Duo 1.83 GHz proces- 
sors, respectively. GK, SD, and TSP are implemented in C++ (GK is imple- 
mented in C# but the most time critical fragments are implemented in C++). 
SG is implemented in Java. Some rough estimation of Java performance 
in the combinatorial optimization applications shows that C++ implementa- 
tion could be approximately two times faster than the Java implementation, 
hence, we assume that fcsc ~ 3 and A;tsp ~ 2. 

In order to assess our estimation, we can compare the results of SD re- 
ported in different papers (note that SD was reimplemented in Java in [95]). 
The time ratio between the SD running times from [95] and our own re- 
sults vary significantly for different instances, but for some moderate size 
instances the ratio is about 2.5 to 3. These results correlate well with the 
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previous estimation. The suggested value k^sp ~ 2 is also confirmed by this 
method. 

The headers of the tables in this section follows: 

Name is the instance name as described in Section 12. 3[ 

Error, % is the average solution error. It is calculated as ^"^"^7°^* ^ 100%, 
where value is the obtained solution weight and opt is the optimal 
solution weight. Recall that the exact solutions are known from [11] 
and from [25] for only 17 of the considered instances. For the rest of the 
instances we use the best solutions ever obtained in our experiments 
instead or in the literature. 

Time, sec is the average running time for the considered heuristic. The 
running times for SG and for TSP are obtained from the corresponding 
papers and, thus, these values have to be adjusted before comparison, 
see above. 

Quality impr., % is the improvement of the average solution quality of the 
GK with respect to some other heuristic. The improvement is calculated 
as Eh — Eqy. where Eh is the average error of the considered heuristic 
H and -Egk is the average error of our heuristic. 

Time impr. is the improvement of the GK average running time with re- 
spect to some other heuristic running time. The improvement is calcu- 
lated as Th/Tqy. where Th is the average running time of the considered 
heuristic H and Tgk is the average running time of our heuristic. 

Opt., % is the number of tests, in percent, in which the optimal solution 
was reached. This value is displayed for only three heuristics since we 
do not have this information for SG. 

Opt. is the weight of the best known solution for the given instance. 

Value is the average solution weight. 

7^ gen. is the average number of generations produced by our heuristic. 
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The results of the experiments presented in Table A. 27 show that our 
heuristic (GK) clearly outperforms all other heuristics with respect to solution 
quality. For each of the considered instances the average solution reached by 
our heuristic is always not worse than the average solution reached by any 
other heuristic and the percent of the runs in which the optimal solution was 
reached is not less than for any other considered heuristic (note that we are 
not able to compare our heuristic with SG with respect to this parameter). 

The average values are calculated for four instance sets (IS). The Full IS 
includes all the instances in our test bed, both symmetric and asymmetric. 
The Sym. IS includes all the symmetric instances in our test bed. The SG IS 
includes all the instances considered in [95] such that m > 40. The TSP IS 
includes all the instances considered in |101j such that m > 40. 

One can see that the average quality of our GK heuristic is approximately 
10 times better than that of SG heuristic, approximately 30 times better 
than that of SD, and for TSP IS our heuristic reaches the optimal solution in 
every run and for every instance, in contrast to TSP that has 0.44% average 
error. The maximum error of GK is 0.27% while the maximum error of SG 
is 2.25% and the maximum error of SD is 3.84%. 



The running times of the considered heuristics are presented in Table A. 28 



in every experiment, the running time of GK is not worse than the running 
time of any other heuristic: the minimum time improvement with respect to 
SG is 6.6 that is greater than 3 (recall that 3 is the adjusting coefficient for 
SG evaluation platform, see above), the time improvement with respect to 
SD is never less than 1.0 (recall that both heuristics were tested on the same 
platform), and the minimum time improvement with respect to TSP is 4.6 
that is greater than 2 (recall that 2 is the adjusting coefficient for TSP evalu- 
ation platform, see above). The average time improvement is approximately 
12 times for SG (or 4 times if we take into account the platforms difference), 
3 times for SD, and 11 times for TSP (or 5 times if we take into account the 
platforms difference). 

The stability of GK is high. E.g., we ran GK for the 89pcb442 instance 
100 times, and the optimal solution was obtained in every run. The time 
standard deviation was 0.27 sec; the minimum and the maximum running 
times were 1.29 s and 2.45 s, respectively, and the average was 1.88 s. For 100 
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runs of 217vml084, the average running time was 65.32 s, the minimum and 
the maximum times were 44.30 s and the standard deviation was 13.57 s. The 
average solution was 130994 (0.22% above the best known), the minimum 
and the maximum were 130704 (exactly the best known) and 131845 (0.87% 
above best known), and the standard deviation was 331. 



Some details on the GK experiments are presented in Table |A.29[ The 
table includes the average number of generations produced by the heuristic. 
One can see that this number is relatively small: note that the SD and TSP 
limit the number of generation to 100 while they consider only the instances 
with m < 90; SG terminates the algorithm after 150 idle generations. This 
shows that our heuristic does not require a lot of generations because of the 
powerful local search procedure and large population sizes. 

All the materials required to reproduce our experiments is available on- 
line EH. 



5.3 Population Sizing 

When implementing a memetic algorithm, one faces a lot of questions. Some 
of these questions, like selecting the most appropriate local search or crossover 
operators, were widely discussed in the literature while others are still not in- 
vestigated enough. In this research we focus our attention on the population 
sizing in memetic algorithms. 

Population size is the number of solutions (chromosomes) maintained at 
a time by a memetic algorithm. Many researchers indicate the importance 
of selecting proper population sizes SSI SZj. However, the most usual 
way to define the population size is to fix it to some constant at the design 
time [IHI inn nil |52]. Several more sophisticated models based on statistical 
analysis of the problem or self-adaptive techniques are proposed for genetic, 
particle swarm optimization and some other evolutionary algorithms [IHI ED 
EHl SSI HZl |63l El] but they all are not suitable for memetic algorithms because 
of the totally different algorithm dynamics. 

It is known [1^ that in memetic algorithms the population size, the so- 
lution quality and the running time are mutually dependent. Often the 
population size is fixed at the design time which, for a given algorithm with 
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a certain termination criterion, determines the solution quality and the run- 
ning time. However, in many applications it is the running time which has 
to be fixed. This leads to a problem of finding the most appropriate pop- 
ulation size m for a fixed running time r such that the solution quality is 
optimized. However, the population size m depends not only on the given 
time T but also on the instance type and size, on the local search performance 
and on the computational platform. The fact that the optimal population 
size depends on the particular instance, forces researchers to use parameter 
control to adapt dynamically the population size for all the factors during 
the run (see, e.g., [IZl ED E3] ) • However, none of these approaches consider 
the running time of the whole algorithm and, hence, are poorly suitable for 
a strict time limitation. 

Instead of it, we have found a parameter encapsulating all these factors, 
i.e, a parameter which refiects on the relation between the instance, the local 
search procedure and the computation platform. It is the average running 
time t of the local search procedure applied to some solutions of the given 
instance. Definitely this time depends on the particular solutions but later 
we will show that t can be measured at any point of the memetic algorithm 
run with a good enough precision. 

Now we can find a near-optimal population function of r 

and t. In particular, it can be calculated as 

mopt{T,t) = a ■ — , (5.2) 

where a, b and c are some tuned [22] constants which refiect on the specifics 
of the other algorithm factors. 

Observe that this is not a pure parameter tuning. Indeed, the population 
size depends on the average local search running time t which is obtained dur- 
ing the algorithm run. Thus, our approach is a combination of the parameter 
tuning and control. 



In our previous attempt (see Section 5.1.3) to adjust the population size 
we assumed that it depends on the instance size n only (i.e., m = m{n)) 
but an obvious disadvantage of this approach is that it does not differentiate 
between instance types. 
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5.3.1 Managing Solution Quality and Population Siz- 
ing 

Having some fixed procedures for production of the first generation (Step [l] 
in Figure 5.1), improving a solution (Steps [2] and 3b) and obtaining the next 
generation from the previous one (Steps |3a] and 3c), the algorithm designer 
is able to manage the solution quality and the running time of the algorithm 
by varying the termination criterion (Step |3]) and the population size, i.e., 
the number of maintained solutions in Steps [T] and 3c 



Usually, a termination condition in a memetic algorithm tries to predict 
the point after which any further effort is useless or, at least, not efficient. 
A typical approach is to count the number Jidie of running generations which 
did not improve the best result and to stop the algorithm when this number 
reaches some predefined value. A slightly more advanced prediction method 
is applied in our state-of-the-art algorithm for GTSP (see Section 5.1.7). It 
stops the algorithm when Jidie reaches k ■ Ip^ev, where A; > 1 is a constant and 
Jprev is the maximum li^ie obtained before the current solution was found. 

In case of such termination conditions, the running time of the algorithm 
is unpredictable and, hence, cannot be adjusted for one's needs. Observe 
that many applications (like real-time systems) in fact have strict time lim- 
itations. To satisfy these limitations, we bound our algorithm within some 
fixed running time and aim to use this time with the most possible efficiency. 
Below we discuss how the parameters of the algorithm should be adjusted 
for this purpose. 



5.3.2 Population Size 

Population size is the number of solutions maintained by a memetic algorithm 
at the same time. This number may vary from generation to generation but 
we decided to keep the population size constant during the algorithm run in 
order to simplify the research. 

Let I be the total number of generations during the algorithm run and 
m be the population size. Then the running time of the whole algorithm is 
proportional to / • m. Indeed, the most time consuming part of a memetic 
algorithm is local search. The number of times the local search procedure is 
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Figure 5.2: The average time required for one local search run depends only marginally on 
the proportion between the population size and the number of generations. These three 
lines correspond to three runs of our memetic algorithm. In every run we used different 



local search procedures (IDV, sDV and sDVy, for details see Section 5.4.61 and different 
given times r (3 s, 10 s and 30 s). 



applied is proportional to I-m, and we have shown empirically (see Figure 5.2 ) 
that the average running time of a local search depends only marginally on 
the population size. Since we fix the running time of the whole algorithm, 
we get: 

I ■ m ^ const . 

In other words, we claim that inversely proportional change of I and m 
preserves the running time of the whole algorithm; our experiments confirm 
it. 

Since I ■ m = const, we need to find the optimal ratio between / and m. 
Our experimental analysis shows that this ratio is crucial for the algorithm 
performance: for a wrongly selected ratio between I and m, the relative 
solution error, i.e., the percentage above the optimal objective value, may be 



twice as big as the relative solution error for a well fitted ratio, see Figure 5.3 



Observe that the optimal ratio between / and m depends on the following 
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Figure 5.3: The solution quality significantly depends on the population size. For every 
instance, local search and given time, there exists some optimal population size. On this 
plot we show how the relative solution error depends on the population size for different 
types and sizes of instances (for detailed descriptions of the particular instance types, see 
Section [O). 



factors: 

• Given time r; 

• Instance type and size; 

• Computational platform; 

• Local search procedure; 

• Genetic operators and selection strategies. 

Note that all factors but the first one are hard to formalize. Next we will 
discuss relations between these factors. 

Since we assume that almost only the local search consumes the proces- 
sor time (see above), the computational platform affects only the local search 
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procedure. Another parameter which greatly influences the local search per- 
formance is the problem instance; it is incorrect to discuss a local search 
performance without considering a particular instance. 

Let t be the average running time of the local search procedure applied 
to some solution of the given instance being run on the given computational 
platform. (Recall that this time stays almost constant during the algorithm 



run, see Figure 5.2 ) Our idea is to use t as the value which encapsulates 
the specifics of the instance, of the computational platform and of the local 
search procedure. 

Definitely the local search and the instance are also related to the genetic 
operators and selection strategies, but we assume that this relation is not 
that important; our computational experience confirms this. 

Hence, we can calculate the near-optimal population size m-opt = /(t, r), 
and the rest of the factors are indirectly included into the function / def- 
inition. Obviously mopt grows with the growth of r and reduces with the 



growth of t. We propose a flexible function (5.2) for mopt. The constants 
a, b and c are intended to reflect on the specifics of genetic operators and 
selection strategies. Observe that variation of a, b and c may significantly 
change the behavior of mopt. 

Since a, b and c are only related to the fixed parts of the algorithm, 
they should be adjusted before the algorithm's run, i.e., these parameters 
should be tuned [22]. However, the whole approach should be considered as 
a combination of parameter tuning and control since the time t is obtained 
during the algorithm's run. 

5.3.3 Choosing Constants a, b and c 

Our approach has two stages: tuning the constants a, b and c according to 
the algorithm structure, and finding the average running time t of the local 
search procedure. Having all these values, we can calculate the near-optimal 



population size mopt according to (5.2) and run the algorithm. 



This section discusses the first stage of our approach, i.e., tuning the 
constants a, b and c. The next section discusses finding the value t. 



The constants a, b and c in (5.2) should be selected to minimize the 
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solution error for all combinations of local searches A, instances (j) and given 
times r which are of interest. In practice this means that one should select a 
representative instance set $, assign the most appropriate local search A = 
A(0) for every instance G $ and define several given times r G T which will 
be used in practice. Note that if \T\ = 1, i.e., only one given time is required, 



then the number of constants in (5.2) can be reduced: mopt{t) = a/t 



Let Ama{^, a, 0, r) be a solution obtained by the memetic algorithm for 
the population size m, local search A, instance and given time r. Let w{A) 
be the objective value of a solution A. 

We need some measure of the memetic algorithm quality which reflects 
on the success of choosing a particular population size. This measure should 
not depend on the rest of the algorithm parameters, i.e., it should have 
similar values for all the solutions obtained for the best chosen population 
sizes whatever is the instance, the local search or the given time. Clearly one 
cannot use the relative solution error since its value hugely depends on the 
given time and other factors. 

We propose using sca/ec^ solution errors as follows. Let Wmin(A, 0, r) and 
Wmaxi^, 0, t) be the minimum and the maximum objective values obtained 
for the given A, and r: 

Wmin(A, 0, r) = min w{AMAim, A, 0, r)) and 

m 

Wmax(A, 0, r) = msiXw{AMA{m, A, 0, r)) . 

m 

Then the scaled error e(m. A, 0, r) of the solution AuA{rn, A, 0, r) is calculated 
as follows: 

. X , N w(Ama("^, A,0,r)) - w;i„in(A,0,r) 
e(m,A,0,r) = 100% . 

Wmax(A, 0, r) - Wmin(A, 0, t) 

In other words, the scaled solution error shows the position of the solution 
obtained for the given population size between the solutions obtained for the 
best and for the worst values of m. The scaled solution error is varied in 
[0%, 100%]; the smaller e, the better the solution. Note that this scaled error 
has some useful theoretical properties |104j . 



•^Sometimes in the literature it is also called differential. 
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Since all the scaled solution errors have comparable values, we can use 
the average for every combination of r G T and G $ as an indicator of 
mopt function success: 



7 = e(mopt(r,t(A,0)), A,0,r) . (5.3) 

(Note that we use t(A, 0) because the average local search running time t 
depends on the local search procedure A and the instance 0; recall A = A(0).) 
Obviously, 0% < 7 < 100%, and the smaller 7, the better mopt- 

The number of runs of the memetic algorithm required to find the best 
values of a, b and c can be hug^ which makes the approach proposed in this 
research unaffordable. For the purpose of decreasing the computation time 
we suggest the following dynamic programming technique. 

1. Let $ be the test bed and T be the set of the given times we are going 
to use for our algorithm. 

2. For every instance G $ set the most appropriate local search A = 
A(0). 

3. Let M be the set of reasonable population sizes. One can even reduce 
it by removing, e.g., all odd values from M, or leaving only certain 
values, e.g., M = {2, 4, 8, 16, . . .}. 

4. Calculate and save e(m, A(0), 0, r) for every m G M, G $ and t & T. 

5. Measure and save t(A(0), 0) for every 0. For this purpose run the local 
search A(0) after a construction heuristic. 



6. Now for every combination of a, b and c compute 7 according to (5.3); 
every time the relative solution error e(m, A(0), 0, r) is required, find 
m' G M which is the closest one to m and use the corresponding pre- 
calculated value. The discretization of a, b and c should be chosen 
according to available resources. 



''Note that since memetic algorithms are stochastic, one should run every experiment 
several times in order to get a better precision. 
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7. Fix the combination of a, b and c which minimizes 7. This finishes the 
tuning process. 

5.3.4 Finding Local Search Average Running Time t 



In order to calculate the near-optimal population size rriopt according to (5.2 ), 
we need to find t at the beginning of the memetic algorithm run. Recall that 
the value t is the average running time of the local search procedure applied 
to some solutions of the given instance. Definitely this value significantly 
depends on the particular solutions. However, the solutions in a memetic 
algorithm are permanently perturbed and, thus, they are always moved out 
from the local minima before the local search is applied. This guaranties 
some uniformity in the improvement process during the whole algorithm. 
Hence, we are able to measure the time t at any point. 

Our algorithm produces and immediately improves the solutions for the 
first generation until rrii < Tnopt{T,tcuT/^i), where mi is the number of al- 
ready produced solutions, r is the time given to the whole memetic algorithm, 
tcur is the time already spent to generate solutions for the first generation and 



"^optlT, t) is the population size calculated according to (5.2). When the first 
generation is produced, the size of the population for all further generations 
is set to m = mopt(T, ^cur/'"^l)• 



5.4 Other Details of MAP Memetic Algorithm 



As a case study for the population sizing proposed in Section [5.3.1| we decided 
to use the Multidimensional Assignment Problem. 

5.4.1 Main Algorithm Scheme 



While the general scheme of a typical memetic algorithm (see Figure 5.1) is 
quite common for all memetic algorithms, the set of genetic operators and 
the way they are applied can vary significantly. In this research we use quite 
a typical (see, e.g., [67]) procedure to obtain the next generation: 



selection (^{gl} U mutation(^g^ \ {gl}) U crossover (^g^)^ , (5.4) 
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where is the kth generation and g\ is the best assignment in the kth 
generation. For a set of assignments G the function selection{G) simply 
returns mj+i best distinct assignments among them, where is the size of 
the kth generation (if the number of distinct assignments in G is less than 
rrii+i, selection returns all the distinct assignments and updates the value of 
rrii+i accordingly). Note that the assignment g{ avoids the mutation thus 
preserving the currently best result. The function mutation{G) is defined as 
follows: 

I , \ LocalSearch{peHurh{g,Hm)) if r < p„ 
mutation{G) — \\ s (5.5) 
1^ g otherwise 

where r e [0, 1] is chosen randomly every time and the constants Pm = 0.5 
and iim = 0.1 define the probability and the strength of mutation operator 
respectively. The function crossover{G) is calculated as follows: 

{l-mi+i-mi)/2 

crossover{G) = \^ LocalSearch{crossover{uj,Vj)) (5.6) 

where Uj and Vj are assignments from G randomly selected for every j — 
1,2, . . . , {I • rrii+i — mi)/2 and I — 3 defines ratio between the produced and 
selected for the next generation solutions. The functions crossover{x,y), 
perturb {x, /i) and LocalSearch{x) are discussed below. 

5.4.2 Coding 

Coding is a way of representing a solution as a sequence of atom values 
such as boolean values or numbers; genetic operators are applied to such 
sequences. Good coding should meet the following requirements: 

• Coding code{x) should be invertible, i.e., there should exist a decod- 
ing procedure decode such that decode{code{x)) — x for any feasible 
solution X. 

• Evaluation of the quality (fitness function) of a coded solution should 
be fast. 



5.4. Other Details of MAP Memetic Algorithm 



147 



• Every fragment of the coded solution should refer to just a part of the 
whole solution, so that a small change in the coded sequence should 
not change the whole solution. 

• It should be relatively easy to design algorithms for random modifi- 
cation of a solution (mutation) and for combination of two solutions 
(crossover) which produce feasible solutions. 

Huang and Lin [321 ^ local search procedure which, given first two 
dimensions of an assignment, determines the third dimension (recall that the 
algorithm in [52] is designed only for 3-AP). Since the first dimension can 



always be fixed without any loss of generality (see Section 1.2), one needs 
to store only the second dimension of an assignment. Unfortunately, this 
coding requires a specific local search and is robust for 3-AP only. We use a 
different coding; a vector of an assignment is considered as an atom in our 
algorithm and, thus, a coded assignment is just a list of its vectors. The 
vectors are always stored in the first coordinate ascending order, e.g., an 
assignment consisting of vectors (2,1,1), (4,4,2), (3,2,3) and (1,3,4) (see 



Fig. 1.1) would be represented as 

(1,3, 4), (2, 1,1), (3, 2, 3), (4, 4, 2) . 
Two assignments are considered equal if they have equal codes. 

5.4.3 First Generation 



As it was shown is Chapter |4] (and we also confirmed it empirically by test- 
ing our memetic algorithm with construction heuristics described in Sec- 
tion 2.5.1), it is beneficial to start any MAP local search or metaheuristic 



from a Greedy construction heuristic. Thus, we start from running Greedy 



(we use the improved implementation, see Section 2.5.3) and then perturb it 



using our perturb procedure (see Section 5.4.5 ) to obtain every item of the 
first generation: 

= LocalSearch{perturb{greedy , fif)) , 
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where greedy is an assignment constructed by Greedy and /ij = 0.2 is the 
perturbation strength coefficient. Since perturb performs a random modifi- 
cation, it guarantees some diversity in the first generation. 

The number of assignments to be produced for the first generation is 
discussed in Section 15.3.41 

5.4.4 Crossover 

A typical crossover operator combines two solutions, parents, to produce two 
new solutions, children. Crossover is the main genetic operator, i.e., it is 
the source of a genetic algorithm strength. Due to the selection operator, 
solutions consisting of 'successful' fragments are spread wider than others and 
that is why, if both parents have some similar fragments, these fragments are 
assumed to be 'successful' and should be copied without any change to the 
children solutions. Other parts of the solution can be randomly mixed and 
modified though they should not be totally destroyed. 

The one-point crossover is the simplest example of a crossover; it produces 
two children x' and y' from two parents x and y as follows: x[ = Xi and 
y'i = yi for every i = 1,2, ... ,k, and x'^ = yi and y[ = Xi for every i = 
k + 1, k + 2, . . . ,n, where k G {1, 2, . . . ,n — 1} is chosen randomly. One can 
see that if Xi = yt for some i, then the corresponding values in the children 
sequences will be preserved: x[ = y[ = Xi = y^. 

However, the one-point and some other standard crossovers do not pre- 
serve feasibility of MAP assignments since not every sequence of vectors can 
be decoded into a feasible assignment. We propose a special crossover op- 
erator. Let X and y be the parent assignments and x' and y' be the child 
assignments. First, we retrieve equal vectors in the parent assignments and 
initialize both children with this set of vectors: 

x = y' = xP[y . 

Let k = \x n y\, i.e., the number of equal vectors in the parent assignments, 
p = x\x' and q = y \y', where p and q are ordered sets. Let vr and u be 
random permutations of size n — k. Let r be an ordered set of random values 
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uniformly distributed in [0, 1]. For every j = 1,2, . . . ,n — k the crossover sets 

x' = x'ul ^-(^-^ < and y' = y'ul '^^^^ < . 

I Quiij) otherwise 1 p-^^j) otherwise 

Since this procedure can yield infeasible assignments, it requires addi- 
tional correction of the child solutions. For this purpose, the following 
is performed for every dimension d = 1, 2, . . . , s and for every child as- 
signment c. For every i such that 3j < i : = set = r where 
r G {1, 2, . . . , n} \ {c\, c^, . . . , c^} is chosen randomly. In the end of the cor- 
rection procedure, sort the assignment vectors in the ascending order of the 



first coordinates (see Section 5.4.2). 



In other words, our crossover copies all equal vectors from the parent 
assignments to the child ones. Then it copies the rest of the vectors; every 
time it chooses randomly a pair of vectors, one from the first parent and 
one from the second one. Then it adds this pair of vectors either to the 
first and to the second child respectively (probability 80%) or to the second 
and to the first child respectively (probability 20%). Since the obtained 
child assignments can be infeasible, the crossover corrects each one; for every 
dimension of every child it replaces all duplicate coordinates with randomly 
chosen correct ones, i.e., with the coordinates which are not currently used 
for that dimension. 



Note that (5.6) requires / ■ mj+i — m-j to be even. If mj+i = rrii = moir, t) 
then / ■ mj_|_i — rrii is always even (recall that / = 3). However, the size of the 
population is not guaranteed and, hence, / ■ mj+i — m, = (/ — 1) ■ m may take 
odd values. To resolve this issue, we remove the worst solution from the zth 
generation if / ■ mj+i — rrii appears to be odd. 

We also tried the crossover operator used in j52j but it appeared to be 
less efficient than the one proposed here. 



5.4.5 Perturbation Algorithm 

The perturbation procedure perturb{x, fi) is intended to modify randomly an 
assignment x, where the parameter /i defines how strong is the perturbation. 
In our memetic algorithm, perturbation is used to produce the first generation 
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and to mutate assignments from the previous generation when producing the 
next generation. 

Our perturbation procedure perturb{x, /i) performs \nji/2'\ random swaps. 
In particular, each swap randomly selects two vectors and some dimension 
and then swaps the corresponding coordinates: swap and x^, where 
u,v G {l,2,...,n} and d G {l,2,...,s} are chosen randomly; repeat the 
procedure \n^/2\ times. For example, if /i = 1, our perturbation procedure 
modifies up to n vectors in the given assignment. 



5.4.6 Local Search Procedure 

An extensive study of a number of local search heuristics for MAP is pre- 
sented in Chapter |4j it includes both fast and slow but powerful algorithms. 
It also shows that a combination of two heuristics can yield a heuristic supe- 
rior to the original ones. 

Here we omit the results for 3-opt and v-opt. The experiments show that 
our memetic algorithm is unsuccessful with these local searches. Note that 
similar conclusions were indicated in Chapter |4} 

Recall that we proposed a division of instances into two groups: instances 
with independent weights and instances with decomposable weights. The 
weight matrices of the instances with independent weights have no struc- 
ture, i.e., there is no correlation between weights w{u) and w{v) even if the 
vectors u and v are different in only one coordinate. In contrast, the weights 
of the instances with decomposable weights are defined using the graph for- 



mulation of MAP (see Section 1.2) and have the structure of (2.1). Most of 
the instances which have some practical interest and which do not belong to 
the group of independent weight instances can be represented as instances 
with decomposable weights, see, e.g.. Clique and SquareRoot instance families 



in Section [2711 

It is known that even for a fixed optimization problem there is no local 
search procedure which would be the best choice for all types of instances 
[65| [66] . Splitting all the MAP instances into two groups, namely instances 
with independent and decomposable weights, gives us a formal way to use 
appropriate local searches for every instance. In particular, it was shown 
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that the instances with independent weights are better solvable by sDVy 
while the dimensionwise heuristics are the best choice for the instances with 
decomposable weights. 

Table \K^30 presents a comparison of the results of our memetic algorithm 



based on the local search procedures discussed above. The time given for 
every run of the algorithm is 3 seconds. The table reports the relative solution 
error for every instance and every considered algorithm. The column 'best' 
shows the best known solution for each instance. 

One can see that the outcomes of Chapter |4] are repeated here, i.e., for 



the Random instances (see Section 2.1) sDVv provides clearly the best perfor- 



mance; for the instances with decomposable weights, i.e., for the Clique and 
SquareRoot instances, the fast heuristics IDV, 2DV, sDV, IDV2 and 2DV2 per- 
form better than others in almost every experiment, and sDV shows the best 



average result among them (though in Table A. 30 2DV slightly outperforms 
it, for other given times sDV shows the best results). 

Thereby, in what follows we use sDVy as a local search for the instances 
with independent weights and sDV for the instances with decomposable 
weights. 

5.4.7 Population Size Adjustment 



The constants a, b and c were selected to minimize 7 (see Section 5.3.2); 



as an instance set $ we used the full test bed (see Section 2.1), the given 
times were T = {1 s, 3 s, 10 s, 30 s, 100 s}, the generation sizes were M = 
{2, 3, 5, 8, 12, 18, 27, 40, 60, 90, 135} and local search A(0) was selected accord- 



ing to Section 5.4.6 The best value of 7 = 13% was obtained for a = 0.08, 



b = 0.35 and c = 0.85 (see (5.2)). Note that these values are not a compro- 
mize and present a minimum for every separate instance set and given time. 
Observe also that fixing m to some value leads to 7 > 19% for the same set 
of instances, local searches and given times. 

Slight variations of the constants a, b and c do not influence the per- 
formance of the algorithm significantly. Moreover, there exist some other 
values for these parameters which also yield good results. The values of the 
constants should not be adjusted for every computational platform. 
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5.5 Experimental Evaluation of MAP Memetic 
Algorithm 

Three metaheuristics were compared in our experiments: 

• An extended version of the memetic algorithm in [52] (HL). 

• An extended version of the simulated annealing algorithm in [16] (S A) . 

• Our memetic algorithm (GK). 

All the heuristics are implemented in Visual C++ and evaluated on a 
platform based on AMD Athlon 64 X2 3.0 GHz processor. Our implementa- 
tions as well as the test bed generator and the best known assignments are 
available on the web [57] . 

5.5.1 HL Heuristic 

For the purpose of comparison, the Huang and Lim's memetic algorithm was 
extended as follows: 

• The coded assignment contains not only the second dimension but it 
stores sequentially all the dimensions except the first and the last ones, 
i.e., an assignment {e^, e^, . . . , e*} is represented as el, . . . , Cg, e\, 
el, . . . , Cg, . . . , ej_]^, e^„]^, . . . , e'^_^ {e\ = i for each i and can be 



chosen in an optimal way by solving an AP, see Section 5.4.2). 



The local search heuristic, that was initially designed for 3-AP, is ex- 
tended to IDV as described in Section |4?T1 



The crossover, proposed in [52], is applied separately to every dimen- 
sion (except the first and the last ones) since it was designed for one 
dimension only (recall that the memetic algorithm from [52J stores only 



the second dimension of an assignment, see Section 5.4.2). 



The termination criterion is replaced with a time check; the algorithm 
terminates when the given time is elapsed. 
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Our computational experience show that the solution quality of our imple- 
mentation of the Huang and Lim's heuristic is similar to the results reported 
in [22] and the running time is reasonably larger because of the extension for 
s > 3. 

5.5.2 SA Heuristic 

The Simulated Annealing heuristic in [16j was originally proposed for an 
arbitrary number of dimensions. We reimplemented it and our computational 
experience show that both the solution quality and the running time^of our 
implementation of the Simulated Annealing heuristic are similar to the results 
reported in [TB] . 

For the purpose of comparison to other heuristics we needed to fit SA for 
using a predefined running time. We tried two strategies: 

• An adaptive cooling ratio R (see [IS]). The value R is updated before 
each change of the temperature as follows: 

R = and / = (r - te) ■ ^ , 

where T is the current temperature (see [IS]), is the elapsed time, r is 
the given time and / is the expected number of further iterations which 
is calculated according to the number i of already finished iterations. 

• An adaptive number of local search iterations NUM^^^ (see [16]). The 
value NUM^i^x is updated before each change of the temperature as 
follows: 

iVt/M^ax = (r - te) ■ f ■ 7 : , 

te 1-1' 

where te is the elapsed time, r is the given time, c is the total number 
of local search iterations already performed, i is the number of the al- 
gorithm iterations already performed and I is the number of algorithm 
iterations to be performed. Since the cooling ratio R as well as the 

''In our experiments, the running times of the heuristic were always approximately 20 
times smaller than the results reported in [16] which can be explained by a difference in 
the computational platforms. 
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initial and the final temperatures Tgtart and Tgnai are fixed, the number 
I of iterations of the algorithm is also fixed: 



initial 

In both adaptations, the algorithm terminates if the given time is elapsed: 

t > T. 

Both adaptations yielded competitive algorithms though according to our 
experimental evaluation the second adaption which varies the number of local 
search iterations appears to be more efficient. One can assume that the best 
adaptation should vary both the cooling ratio and the number of local search 
iterations but this is a subject for another research. Hence, in what follows 
the SA algorithm refers to the extension with the adaptive number of local 
search iterations. 



5.5.3 Experiment Results 



The main results are reported in Tables |A.31| and |A.32t in these tables, 
we compare our algorithm (GK) to the Simulated Annealing heuristic (SA) 
and the memetic algorithm by Huang and Lim (HL). The comparison is 
performed for the following given times r: 0.3 s, 1 s, 3 s, 10 s, 30 s, 100 s and 
300 s. Every entry of these tables contains the relative solution error averaged 
for 10 instances of some fixed type and size but of different seed values (see 



Section 2.1 for details); we did not repeat every experiment several times 



which is typical for stochastic algorithms. The value of the relative solution 
error e{A) is calculated as follows 



e{A) 



wjA) 



best I 



- 1 ■ 100% 



(5.7) 



where A is the obtained solution and Abcst is the best known solution^ 

^The best known solutions were obtained during our experiments with different lieuris- 



tics and the corresponding weights can be found in Table A. 30 For the Random instances 
we actually know the optimal objective values; it is proven for large values of n that a 
Random instance has a solution of the minimal possible weight (see Section 2.2 1; since we 



obtained the minimal possible solutions for every Random instance in our experiments, we 



can extend the results of Section 2.2 to all the Random instances in our test bed. Hence, 
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The results for Product and Geometric instances were excluded from Ta- 



bles A. 30 , A. 31 and A. 32 because even the stand alone local searches used 
in our memetic algorithm are able to solve Geometric instances to optimality 
and Product instances to less than 0.04% over optimalitjj^ Similar result were 
reported in Chapter |4j 

The average values for different instance families, numbers of dimensions 
and instance sizes are provided at the bottom of each table. The best among 
HL, SA and GK results are underlined in every row for every particular given 
time. 

One can see that GK clearly outperforms both SA and HL for all the 
given times. Moreover, GK is not worse than the other heuristics in every 
experiment which proves its flexibility and robustness. A two-sided paired 
t-test confirms statistical difference even between GK with r = 1 s and HL 
with T = 100 s because the p-value in this case was less than 0.0001 for both 
instances with independent and decomposable weights. This shows that HL 
is not able to use large time efficiently. 

The solution quality of GK significantly depends on the given time: for 
the instances with both independent and decomposable weights a three times 
increase of the running time improves the solution quality in approximately 
1.2 to 2 times. Recall that the approach proposed in this research to select 
the most appropriate population size reduces 7 more than 1.5 times (see 
Section 5.3.2) and, hence, it would take roughly 1.5 to 10 times more time to 
get the same solution quality for a memetic algorithm with a fixed population 
sizeEl 

It is worth noting that we experimented with different values of the GK 
algorithm parameters such as fij, fim, Pm, I, etc. and concluded that small 
variations of these values do not significantly influence the algorithm perfor- 
mance. 

For the instances with independent weights all the algorithms perform 
better for the large instances rather than for the small ones. One can explain 



we do not need the GP instances anymore. 

^We believe that the best known solutions for both Geometric and Product instances 
are optimal but we are not able to verify it. 

^Note that 7 is not just the average for the solution errors and, thus, these calculations 
are very approximate. 
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it by showing that the number of vectors of the minimal weight in Random 
is proportional to while the number of vectors in an assignment is n and, 
thus, the number of global minima increases with the increase of n (see 



Section 2.2 In contrast, the instances with decomposable weights become 
harder with the growth of n. 

Since the HL heuristic uses IDV local search, it performs quite well for 
the instances with decomposable weights and yields solutions of poor quality 
for the instances with independent weights. Due to the fixed population size, 
it does not manage to solve some large instances in short times which results 



in huge solution errors reported in Table A. 31 for the instances 3cq70, 3sr70, 
3cql00 and 3srl00. HL was initially designed for 3-AP and tested on small 
instances [52] and, hence, it performs better for the instances with small s 
and n. 

The 5 A heuristic is less successful than the others; for both instances with 
independent and decomposable weights it is worse than both HL and GK in 
almost every experiment. The solution quality of SA improves quite slowly 
with the increase of the running time; it seems that SA would not be able to 
significantly improve the solution quality even if it is given much larger time. 



5.6 Conclusion 

In this chapter, we proposed two memetic algorithms, namely for the Gen- 
eralized Traveling Salesman Problem and the Multidimensional Assignment 
Problem. The first algorithm is featured with a powerful local search proce- 
dure, variable population size, well-fitted genetic operators and new efficient 
termination condition. Unlike other heuristics in the literature, our algo- 
rithm is able to process both symmetric and asymmetric GTSP instances. 
Experimental analysis shows that the proposed heuristic dominates all other 
evolutionary algorithm for GTSP known from the literature. Moreover, it 
was able to significantly improve the best known solutions for a number of 
standard instances. 

Based on our experience in GTSP algorithm design, we have developed 
the idea of the variable population size and replaced the termination con- 
dition with a predefined running time. In this case the goal was to adjust 
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the population size such that the given time would be used with the maxi- 
mum efficiency. In our approach, this is achieved by adjusting the population 
size according to the given time, the local search procedure and the problem 
instance. As a case study problem, we used MAP. 

Our experiments have confirmed that the proposed population sizing leads 
to an outstanding flexibility of the algorithm. Indeed, it was able to perform 
efficiently for a wide range of instances, being given from 0.3 to 300 seconds 
of the running time and with totally different local search procedures. As an 
evidence of its efficiency, we compared it to two other MAP metaheuristics 
proposed in the literature and concluded that our algorithm clearly outper- 
forms the other heuristics with no exception. Moreover, the difference in the 
solution quality of our memetic algorithm (GK) and the previous state-of- 
the-art memetic algorithm (HL) continuously grows with the increase of the 
given time which confirms that GK is much more flexible than HL. 

The main factors influencing the performance of a memetic algorithm are 
running time, computational platform, problem instance, local search proce- 
dure, population size and genetic operators. We did not focus on the genetic 
operators investigation in this research; however we believe that the opera- 
tors used in our MAP MA are well fitted since our attempts to improve the 
algorithm results by changing the operators have failed. The local search pro- 
cedure and the population size are varied according to the problem instance; 
after an extensive study of the local searches, we show that there are two 
totally different cases of MAP, and for these cases one should use different 
local search procedures. Since these local searches have very different running 
times, the memetic algorithm has to adapt for them. In our approach this is 
achieved by using the adjustable population size which is a function of the 
average running time of the local search. Thereby, the average running time 
of the local search encapsulates not only the local search specifics but also the 
specifics of the instance and the computational platform performance. Since 
the algorithm is self-adjustable, the running time can be used as a parameter 
responsible for the 'solution quality'/'running time' balance and, thus, the 
population size should also depend on the given time. 

The adjustable population size requires several constants to be tuned 
prior to using the algorithm; we proposed a procedure to find the optimal 
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values of these constants. 

In conclusion we note that choosing the most appropriate population size 
is crucial for the performance of a memetic algorithm. Our approach to 
calculate the population size according to the average running time of the 
local search and the time given to the whole algorithm, used to perform well 
for a large variation of the instances and given times and for two totally 
different local searches. Observe, however, that the whole discussion of the 
population sizing does not involve any MAP specifics and, hence, we can 
conclude that the obtained results can be extended to any hard optimization 
problem. 

Further research is required to evaluate the proposed approach in ap- 
plication to other hard combinatorial optimization problems. It is also an 
interesting question if changing the population size during the algorithm's 
run can further improve the results. 
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Chapter 6 
Conclusion 



In this research we proposed a number of algorithms and approaches for 
combinatorial optimization problems. We focused on two combinatorial op- 
timization problems, namely, the Generalized Traveling Salesman Problem 
and the Multidimensional Assignment Problem, and significantly developed 
the knowledge on these problems. Both GTSP and MAP have a lot of im- 
portant applications but were not studied enough in the literature. 

One of the most important questions in heuristic design is experimental 
evaluation. In order to conduct a proper experiment, one needs a represen- 
tative test bed. In Chapter |2] we provide an example of successful adaptation 
of a well-developed TSP test bed for GTSP. However, this approach seems 
to be inapplicable for MAP and, thus, we generalize the existing instance 
families, propose some new ones and introduce a classification; our division 
of the MAP instances into the instances with independent weights and the 
instances with decomposable weights turns out to be essential in our further 
research. 

It is often important to know the optimal objective value for a test in- 
stance. However, it may be impossible to solve a large instance to optimality 
in any reasonable time. In this work, we propose a probabilistic analysis in 
application to one of the most used MAP instance family, namely the Ran- 
dom instance family. For a large enough instance, it is possible to estimate 
the optimal objective value with a very high precision. This approach may 
also be applied to the randomly generated instances for some other problems. 
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Another technique which is apphcable to a wide range of problems is 
preprocessing. In our example, preprocessing is applied to GTSP. Observe 
that the shortest cycle for a GTSP instance visits only m vertices and, hence, 
we may remove up to n — m vertices from the instance in advance and this 
does not influence the optimal solution. Moreover, the problem remains a 
typical GTSP but of a smaller size and, hence, any ordinary solvers may be 
applied to the reduced instances. Our computational experiments showed 
that this reduction may significantly speed up slow GTSP solvers. 

While many researchers focus only on the theoretical properties of the al- 
gorithms, the implementation issues may also be crucial for the algorithm's 
performance. We considered four construction heuristics for MAP and pro- 
posed some simple transformations for each of them in order to optimize the 
implementations with regards to the computer architecture. The improved 
implementations appear to be several times faster than the original ones. 

We also discussed data structures for GTSP and proposed some new 
approaches which are easier and faster for implementation of algorithms. 

In Chapter [3] we thoroughly discussed the local search for GTSP. Unfor- 
tunately, previously there was no stand-alone research in this area and, thus, 
we collected all the existing approaches, classified, extended and improved 
them and also proposed some new algorithms. 

One of the most important GTSP local searches is Cluster Optimization. 
It finds the best vertex selection for a fixed cluster order and it takes only 
0{s'~fn) time. The algorithm was widely discussed in the literature, how- 
ever, we proposed two new refinements which can significantly speed it up in 
certain circumstances. 

Another class of GTSP local searches consists of adaptations of TSP lo- 
cal searches. We provided some theoretical discussion of possible adaptations 
and proposed a unified framework for this approach. Moreover, we signifi- 
cantly improved the existing results for the most powerful 'Global' adapta- 
tion. Apart from being powerful, this adaptation has some nice theoretical 
properties but previously it was too slow. Our approach makes the 'Global' 
adaptation applicable in practice. 

One of the most successful TSP local searches is the Lin-Kernighan heuris- 
tic. We proposed several adaptations of this algorithm for GTSP. Note that 
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it is not a typical local search and, thus, it cannot be adapted straightfor- 
wardly. Moreover, the original heuristic is very complicated for understand- 
ing and implementation and so we propose a new explanation of a simplified 
Lin-Kernighan heuristic. We claim that our simplified version preserves the 
main features of the algorithm. This statement is supported by the success 
of our Lin-Kernighan adaptations. 

We also proposed a new class of GTSP local searches, namely Fragment 
Optimization. These local searches, being quite natural for GTSP, are rel- 
atively slow when implemented naively. We proposed two algorithms to 
explore the corresponding neighborhoods efficiently. 

Chapter |4] is devoted to MAP local search. Similarly to the GTSP, there 
was no stand-alone research in this area before. We collected all existing 
MAP local searches, extended them when necessary and proposed some new 
ones. We also introduced a division of all the MAP local searches into two 
classes: dimensionwise and vectorwise. Having this classification, we pro- 
posed to combine the local searches of different types together. After a 
thorough experimental evaluation we selected the most efficient heuristics, 
and the combined ones turn out to be very successful. 

A significant part of our research is devoted to memetic algorithms. This 
type of evolutionary algorithms intensively applies local search and, thus, is 
essentially interesting in this work. 

Our memetic algorithm for GTSP is featured by a number of new ap- 
proaches like an efficient termination condition or a variable population size 
which is selected according to the problem size and varies during the al- 
gorithm's run. It is worth noting that the local search procedure in our 
memetic algorithm is a combination of several local searches and, thus, it is 
relatively powerful. All these and some other features of the algorithm make 
it extremely successful and, in particular, it dominates all the existing GTSP 
metaheuristics known from the literature. 

When designing a memetic algorithm for MAP, we have further improved 
our population sizing. In our approach, the population size as one of the 
most important parameters of a memetic algorithm is intended to adjust the 
whole algorithm according to the particular instance, local search procedure 
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and time requirements. Being applied to MAP, this approach yielded an 
extremely flexible memetic algorithm capable to work efficiently in a wide 
range of these parameters. We compared our memetic algorithm with two 
other MAP metaheuristics known from the literature and concluded that our 
algorithm, being given the same time, significantly outperforms the other 
heuristics. 

Our research leaves some questions open. In particular, one can doubt 
that the proposed simplified Lin-Kernighan heuristic preserves the main fea- 
tures of the original algorithm and, thus, a formal or experimental proof is 
of interest. It is also interesting to consider combinations of different GTSP 
neighborhoods in the so-called Variable Neighborhood Descend. According 
to our expectations, this may yield several very successful heuristics. In order 
to make our experimental evaluation more representative, it may be bene- 
ficial to consider some additional instance families and to test the existing 
approaches on significantly larger instances. We are also going to apply our 
population sizing approach to the GTSP memetic algorithm in order to prove 
its efficiency on different optimization problems. 
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Appendix A 
Tables 



Table A.l: Time benefit of tlie GTSP Rediietion for the Exact heuristic. 



Vertices Red. Edge Red. Combined Reduction 



Instance 


To, sec 


Ry, % 


B, % 


Re, % 


B, % 


Ry, % 


Re, % 


B, % 


5gr21 


0.8 


38.1 


40 


48.7 


52 


38.0 


45.0 


56 


5ulysses22 


1.7 


50.0 


60 


44.3 


48 


50.0 


39.5 


79 


5gr24 


0.2 


54.2 


74 


33.1 


53 


54.1 


10.4 


81 


6fri26 


0.9 


50.0 


67 


28.7 


18 


50.0 


20.3 


74 


6bayg29 


6.0 


41.4 


19 


0.0 


59 


41.3 


33.6 


70 


10gr48 


16.1 


37.5 


57 


27.0 


2 


37.5 


25.5 


55 


10hk48 


52.7 


12.5 


16 


34.2 


6 


12.5 


32.3 


22 


lleilSl 


32.8 


17.6 


37 


32.6 


17 


17.6 


28.8 


42 


14st70 


150.4 


17.1 


43 


36.5 


17 


17.1 


24.6 


50 


Average 




35.4 


45.9 


31.7 


30.2 


35.3 


28.9 


58.8 



Table A.2: Time benefit of the GTSP Reduction for the SD heuristic. 



Vertices Red. Edge Red. Combined Reduction 



Instance 


To, sec 


Ry, % 


B, % 


Re, % 


B, % 


Ry, % 


Re, % 


B, % 


157rat783 


23.6 


3.2 


11 


9.8 


5 


3.1 


8.4 


36 


200dsjl000 


100.3 


0.8 


47 


9.6 


36 


0.8 


9.4 


42 


201prl002 


54.9 


1.9 


12 


9.2 


22 


1.9 


8.7 


43 


207sil032 


21.3 


8.2 


3 


12.1 


-1 


8.2 


10.2 


24 


212ul060 


88.8 


3.3 


8 


UA 


35 


3.3 


11.2 


42 


217vml084 


78.1 


22.2 


49 


24.0 


-2 


22.2 


8.9 


57 


235pcbll73 


107.9 


0.9 


5 


8.2 


30 


0.9 


8.2 


32 


259dl291 


169.4 


3.7 


9 


12.4 


25 


3.7 


9.8 


26 


261rll304 


140.4 


1.5 


9 


7.9 


47 


1.4 


7.2 


66 


265rll323 


132.6 


1.8 


20 


7.8 


20 


1.7 


7.0 


32 


276nrwl379 


111.5 


0.8 


4 


7.4 


22 


0.7 


7.1 


46 


Average 




4.4 


16.1 


11.2 


21.7 


4.4 


8.7 


40.5 
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Table A. 3: Time benefit of the GTSP Reduction for the SG heuristic. 



Vertices Red. 



Instance 


To, sec 


Rv, % 


B, % 


84fl417.gtsp 


4.5 


10.3 


12 


87gr431.gtsp 


8.3 


0.0 


6 


88pr439.gtsp 


10.2 


2.3 


-3 


89pcb442.gtsp 


11.5 


5.4 





99d493.gtsp 


20.0 


0.8 


7 


107att532.gtsp 


25.1 


3.9 


11 


107si535.gtsp 


16.9 


17.9 


34 


107aU535.gtsp 


29.1 


5.4 


20 


113pa561.gtsp 


14.5 


26.2 


31 


Average 




8.0 


13 



Table A.4: Time benefit of the GTSP Reduction for the GK heuristic. 



Vertices Red. Edge Red. Combined Reduction 



Instance 


To, sec 


Rv, % 


B, % 


Re, % 


B, % 


Rv, % 


Re, % 


B, % 


89pcb442.gtsp 


3.43 


5.4 


16 


12.0 


-2 


5.4 


9.8 


7 


99d493.gtsp 


6.36 


0.8 


2 


17.9 





0.8 


19.4 


2 


107att532.gtsp 


5.96 


3.9 


7 


20.6 


10 


3.9 


18.1 


11 


107si535.gtsp 


4.52 


17.9 


14 


26.5 


8 


17.9 


18.0 


15 


107ali535.gtsp 


8.91 


5.4 


17 


16.6 


19 


5.4 


14.3 


25 


113pa561.gtsp 


6.86 


26.2 


20 


31.3 


6 


26.2 


22.6 


23 


115u574.gtsp 


7.43 


1.9 


-2 


14.4 


-6 


1.9 


14.0 


-1 


115rat575.gtsp 


7.29 


3.1 





11.3 





3.1 


10.9 


2 


i:-')li)(ir)4,u,isp 


•1.47 


13.5 


11 


;-')2.7 


2 


1, •-!..") 


2<s.:-', 


13 






8.7 


!) 


20.4 


4 


<S.7 


17.:-! 


11 
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Table A. 5: Test results of GTSP reduction algorithms. 



Vertex reduction Edge reduction Combined reduction 







7? % 


T 






T 




7? % 


T 


4ulyssesl6 


9 


56.3 


0.0 


62.0 


4 


0.0 


56.3 


23.5 


0.0 


4grl7 


11 


64.7 


0.0 


35.8 


3 


0.0 


64.7 


23.0 


0.0 


5gr21 


8 


38.1 


0.0 


48.7 


3 


0.0 


38.1 


45.0 


0.0 


5ulysses22 


11 


50.0 


0.0 


44.3 


2 


0.0 


50.0 


39.5 


0.0 


5gr24 


13 


54.2 


0.0 


33.1 


3 


0.0 


54.2 


10.4 


0.0 


6fri26 


13 


50.0 


0.0 


28.7 


3 


0.0 


50.0 


20.3 


0.0 


6bayg29 


12 


41.4 


0.0 


37.9 


5 


0.0 


41.4 


33.6 


0.0 


9dantzig42 


6 


14.3 


0.0 


36.2 





0.0 


14.3 


24.9 


0.0 


10att48 


15 


31.3 


0.0 


41.5 


7 


0.0 


31.3 


25.3 


0.0 


10gr48 


18 


37.5 


0.0 


27.0 


4 


0.0 


37.5 


25.5 


0.0 


101ik48 


6 


12.5 


0.0 


34.2 


3 


0.0 


12.5 


32.3 


0.0 


llberlin52 


15 


28.8 


0.0 


36.1 


1 


0.0 


28.8 


35.0 


0.0 


lleilSl 


9 


17.6 


0.0 


32.6 


3 


0.0 


17.6 


28.8 


0.0 


12brazil58 


14 


24.1 


0.0 


24.5 


3 


0.0 


24.1 


29.0 


0.0 


14st70 


12 


17.1 


0.0 


36.5 


3 


0.0 


17.1 


24.6 


0.0 


16eil76 


12 


15.8 


0.0 


28.8 


2 


0.0 


15.8 


28.6 


0.0 


16pr76 


2 


2.6 


0.0 


29.0 


1 


0.0 


2.6 


29.7 


0.0 


20gr96 


13 


13.5 


0.0 


25.8 


3 


0.0 


13.5 


20.6 


0.0 


20rat99 


11 


11.1 


0.0 


23.7 


3 


0.0 


11.1 


23.2 


0.0 


20kroA100 


16 


16.0 


0.0 


20.9 


2 


0.0 


16.0 


18.8 


0.0 


20kroB100 


8 


8.0 


0.0 


28.1 


2 


0.0 


8.0 


25.0 


0.0 


20kroC100 


19 


19.0 


0.0 


27.2 


2 


0.0 


19.0 


24.2 


0.0 


20kroD100 


19 


19.0 


0.0 


27.9 


2 


0.0 


19.0 


19.8 


0.0 


20kroE100 


21 


21.0 


0.0 


26.4 


1 


0.0 


21.0 


20.2 


0.0 


20rdl00 


11 


11.0 


0.0 


32.1 


2 


0.0 


11.0 


28.8 


0.0 


21eill01 


14 


13.9 


0.0 


35.5 


1 


0.0 


13.9 


31.5 


0.0 


211inl05 


9 


8.6 


0.0 


35.4 


3 


0.0 


8.6 


32.4 


0.0 


22prl07 


9 


8.4 


0.0 


35.6 





0.0 


8.4 


35.9 


0.0 


24grl20 


15 


12.5 


0.0 


28.4 


4 


0.0 


12.5 


29.6 


0.0 


25prl24 


17 


13.7 


0.0 


32.5 


3 


0.0 


13.7 


22.2 


0.0 


26bicrl27 


2 


1.6 


0.0 


21.5 


1 


0.0 


1.6 


19.7 


0.0 


26clil30 


16 


12.3 


0.0 


25.9 


3 


0.0 


12.3 


21.2 


0.0 


28prl36 


14 


10.3 


0.0 


22.4 


1 


0.0 


10.3 


26.3 


0.0 


28grl37 


10 


7.3 


0.0 


19.9 


1 


0.0 


7.3 


17.0 


0.0 


29prl44 


19 


13.2 


0.0 


33.2 


2 


0.0 


13.2 


31.1 


0.0 


30clil50 


22 


14.7 


0.0 


19.9 


2 


0.0 


14.7 


18.1 


0.0 


30kroA150 


20 


13.3 


0.0 


22.5 


6 


0.0 


13.3 


19.5 


0.0 


30kroB150 


14 


9.3 


0.0 


23.8 


2 


0.0 


9.3 


23.4 


0.0 


31prl52 


34 


22.4 


0.0 


37.5 


7 


0.0 


22.4 


26.6 


0.0 


32ul59 


33 


20.8 


0.0 


23.5 


3 


0.0 


20.8 


15.1 


0.0 


35sil75 


45 


25.7 


0.0 


27.4 


5 


0.0 


25.7 


17.5 


0.0 


36brgl80 


97 


53.9 


0.0 


57.9 


51 


0.0 


53.9 


16.9 


0.0 


39ratl95 


12 


6.2 


0.0 


22.2 


1 


0.0 


6.2 


20.4 


0.0 


40dl98 


7 


3.5 


0.0 


23.1 


4 


0.0 


3.5 


24.2 


0.0 


40kroA200 


16 


8.0 


0.0 


20.3 


2 


0.0 


8.0 


20.6 


0.0 


40kroB200 


7 


3.5 


0.0 


19.1 


1 


0.0 


3.5 


18.5 


0.0 


41gr202 


4 


2.0 


0.0 


18.8 


1 


0.0 


2.0 


18.5 


0.0 
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Vertex reduction Edge reduction Combined reduction 



Instance 


Ry 


Ry, % 


T 


Re, % 


Ry 


T 


Ry, %, 


Re, % 


T 


45ts225 


40 


17.8 


0.0 


20.0 


2 


0.0 


17.8 


11.2 


0.0 


45tsp225 


12 


5.3 


0.0 


20.5 


2 


0.0 


5.3 


17.1 


0.0 


46pr226 


12 


5.3 


0.0 


29.6 


1 


0.0 


5.3 


28.4 


0.0 


46gr229 


1 


0.4 


0.0 


22.0 





0.0 


0.4 


21.6 


0.0 


53gil262 


16 


6.1 


0.0 


21.8 


3 


0.0 


6.1 


18.9 


0.0 


53pr264 


11 


4.2 


0.0 


21.5 


1 


0.0 


4.2 


20.7 


0.0 


56a280 


20 


7.1 


0.0 


19.4 


1 


0.0 


7.1 


16.1 


0.0 


60pr299 


15 


5.0 


0.0 


16.2 





0.0 


5.0 


14.7 


0.0 


641in318 


13 


4.1 


0.0 


20.5 


2 


0.0 


4.1 


20.8 


0.0 


641inhp318 


13 


4.1 


0.0 


20.5 


2 


0.0 


4.1 


20.8 


0.0 


80rd400 


11 


2.8 


0.0 


14.8 


1 


0.1 


2.8 


13.0 


0.0 


84fl417 


43 


10.3 


0.0 


28.3 


5 


0.1 


10.3 


22.7 


0.1 


87gr431 





0.0 


0.0 


17.2 





0.3 


0.0 


17.2 


0.3 


88pr439 


10 


2.3 


0.0 


14.7 


1 


0.2 


2.3 


15.0 


0.1 


89pcb442 


24 


5.4 


0.0 


11.9 





0.1 


5.4 


9.7 


0.1 


99d493 


4 


0.8 


0.0 


17.8 


1 


0.2 


0.8 


19.4 


0.2 


107att532 


21 


3.9 


0.0 


20.5 


2 


0.3 


3.9 


18.1 


0.3 


107ali535 


29 


5.4 


0.1 


16.6 


2 


0.5 


5.4 


14.3 


0.5 


107si535 


96 


17.9 


0.0 


26.5 


9 


0.3 


17.9 


17.9 


0.1 


113pa561 


147 


26.2 


0.1 


31.3 


5 


0.3 


26.2 


22.6 


0.1 


115u574 


11 


1.9 


0.0 


14.4 


1 


0.2 


1.9 


14.0 


0.2 


115rat575 


18 


3.1 


0.0 


11.2 


2 


0.2 


3.1 


10.9 


0.1 


131p654 


88 


13.5 


0.1 


32.6 


2 


0.8 


13.5 


28.2 


0.5 


132d657 


8 


1.2 


0.0 


10.8 





0.3 


1.2 


9.6 


0.3 


134gr666 





0.0 


0.0 


11.6 





1.0 


0.0 


11.6 


1.0 


145u724 


34 


4.7 


0.1 


10.1 


3 


0.5 


4.7 


8.8 


0.4 


157rat783 


25 


3.2 


0.0 


9.8 


2 


0.4 


3.2 


8.4 


0.3 


200dsjl000 


8 


0.8 


0.1 


9.6 


1 


2.4 


0.8 


9.4 


1.5 


201prl002 


20 


2.0 


0.1 


9.2 


2 


3.0 


2.0 


8.7 


1.6 


207sil032 


85 


8.2 


0.2 


12.1 


12 


1.2 


8.2 


10.2 


0.9 


212ul060 


36 


3.4 


0.1 


14.4 


1 


1.7 


3.4 


11.2 


2.0 


217vml084 


241 


22.2 


0.6 


24.0 


8 


2.3 


22.2 


8.9 


1.3 


235pcbll73 


11 


0.9 


0.1 


8.2 





1.5 


0.9 


8.2 


1.3 


259dl291 


48 


3.7 


0.2 


12.4 


2 


2.3 


3.7 


9.8 


1.7 


261rll304 


19 


1.5 


0.2 


7.9 


2 


2.6 


1.5 


7.2 


2.0 


265rll323 


23 


1.7 


0.2 


7.8 


1 


4.1 


1.7 


7.0 


2.9 


276nrwl379 


11 


0.8 


0.2 


7.4 


1 


3.7 


0.8 


7.1 


2.6 


280fll400 


23 


1.6 


0.9 


17.4 





6.5 


1.6 


17.5 


5.3 


287ul432 


33 


2.3 


0.2 


7.7 


1 


3.2 


2.3 


6.6 


2.6 


316fll577 


44 


2.8 


0.4 


10.3 


2 


5.0 


2.8 


9.2 


4.5 


331dl655 


14 


0.8 


0.2 


6.7 


1 


3.7 


0.8 


6.7 


3.7 


350vml748 


285 


16.3 


2.5 


19.8 


2 


11.4 


16.3 


11.0 


5.5 


364ul817 


5 


0.3 


0.1 


6.2 





4.9 


0.3 


5.8 


4.5 


378rll889 


17 


0.9 


0.7 


7.3 


3 


10.9 


0.9 


6.8 


7.2 


421d2103 


8 


0.4 


0.2 


6.7 


1 


2.9 


0.4 


6.6 


2.7 


431u2152 


10 


0.5 


0.3 


5.2 





7.8 


0.5 


5.0 


6.6 


464u2319 


24 


1.0 


0.6 


3.9 





10.3 


1.0 


3.8 


9.7 


479pr2392 


33 


1.4 


0.9 


5.9 


1 


15.4 


1.4 


5.3 


13.4 


608pcb3038 


29 


1.0 


1.4 


4.7 


1 


45.4 


1.0 


4.7 


36.2 
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Vertex reduction Edge reduction Combined reduction 



Instance 


Ry 


Ry, % 


T 


Re, % 


Ry 


T 


Ry, %, 


Re, % 


T 


759113795 


21 


0.6 


4.9 


6.4 





127.2 


0.6 


6.5 


94.5 


893fnl4461 


22 


0.5 


3.4 


3.1 





80.2 


0.5 


2.9 


46.7 


1183rl5915 


28 


0.5 


7.9 


2.4 


2 


258.1 


0.5 


2.3 


114.1 


1187rl5934 


38 


0.6 


9.4 


3.0 


2 


308.3 


0.6 


2.7 


139.6 


1480pla7397 


196 


2.6 


31.5 


4.6 


1 


2147.9 


2.6 


3.6 


1001.3 


2370rlll849 


37 


0.3 


40.7 














2702usal3509 


21 


0.2 


98.7 















Table A. 6: Experiments with the different variations of the CO algorithm for GTSP. The 
test bed includes only the instances with 7 = 1. 



Running time, /xs 



Instance 


7 


s 


COi 


CO2 


CO3 


CO4 


12brazil58 


1 


16 


1.0 


0.9 


0.9 


0.9 


20kroal00 


1 


8 


1.6 


1.6 


1.6 


1.6 


26bierl27 


1 


27 


2.8 


2.7 


2.9 


2.7 


32ul59 


1 


16 


2.4 


2.1 


2.4 


2.1 


41gr202 


1 


17 


4.4 


3.8 


4.4 


3.8 


53pr264 


1 


12 


5.1 


5.2 


5.2 


5.2 


87gr431 


1 


58 


12.0 


11.3 


12.0 


11.2 


107att532 


1 


20 


12.2 


11.5 


12.1 


11.5 


131p654 


1 


25 


20.9 


20.1 


20.9 


20.1 


200dsjl000 


1 


19 


25.8 


25.2 


25.9 


25.2 


Average 


1.0 


21.8 


8.8 


8.4 


8.8 


8.4 
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Table A. 7: Experiments with the different variations of the CO algorithm for GTSP. The 
test bed includes only the instances with 7 > 1. 



Running time, /xs 



Instance 


7 


s 


COi 


CO2 


CO3 


CO4 


10gr48 


2 


10 


1.1 


1.1 


0.8 


0.8 







7 


1 fi 




n Q 


u.o 


^Ul Oil t7i7 


9 


1 1 

J. J. 


o.yj 


9 7 


1 Q 

J. .J 


1 S 




9 


10 


9 Q 


9 7 


9 


9 1 
z. ± 


20krodl00 


2 


9 


3.6 


2.9 


2.4 


2.3 


20rdl00 


2 


8 


2.9 


2.5 


3.3 


2.8 


211inl05 


2 


12 


3.0 


2.3 


3.1 


2.4 


22prl07 


3 


7 


5.4 


4.9 


2.2 


2.0 


25prl24 


2 


13 


3.8 


3.6 


2.2 


2.1 


26chl30 


2 


10 


4.3 


3.7 


2.5 


2.5 


29prl44 


2 


10 


4.4 


4.2 


2.7 


2.6 


30chl50 


2 


15 


5.7 


5.0 


3.3 


3.2 


30kroal50 


2 


11 


5.5 


4.7 


5.8 


5.0 


36brgl80 


2 


110 


2.7 


2.8 


4.1 


4.3 


39ratl95 


2 


9 


6.8 


6.0 


4.0 


3.7 


45ts225 


3 


9 


8.1 


6.0 


8.5 


6.3 


56a280 


2 


10 


9.8 


8.8 


5.3 


5.2 


207sil032 


2 


15 


48.3 


44.6 


27.6 


26.8 


Awvagc 


2.;i. 


Ki.l 


().8 


(i.l 


4.6 


4.:-! 



Table A. 8: Comparison of GTSP 2-opt implementations. The reported values are running 
times, in ms. 



Basic Global 



Instance 


2ob 




2oq 


simple 


10att48 


0.3 


0.2 


0.3 


0.5 


12brazil58 


0.0 


0.0 


0.1 


0.3 


20rat99 


0.0 


0.1 


0.4 


1.6 


20krocl00 


0.0 


0.1 


0.2 


1.1 


24grl20 


0.0 


0.1 


0.3 


2.0 


28grl37 


0.0 


0.1 


0.6 


3.3 


31prl52 


0.0 


0.1 


0.4 


2.7 


40dl98 


0.0 


0.3 


1.9 


12.9 


45tsp225 


0.0 


0.3 


2.1 


12.6 


56a280 


0.1 


0.5 


3.2 


24.5 


87gr431 


0.1 


1.1 


4.9 


57.7 


107att532 


0.2 


1.8 


7.0 


76.7 


131p654 


0.3 


2.5 


6.5 


179.6 


200(lsjl()()() 


1.0 


().<S 


•11.8 


780.4 


Avcrag(^ 


0.2 


1.0 


5.7 


82.6 



A. Tables 



180 



Table A. 9: GTSP FO implementations comparison. The reported values are running 
times, in ms. 



Algorithm 1 Algorithm 2 



Instance k: 


3 


4 


5 


6 


7 


3 


4 


5 


6 


7 


10att48 


0.3 


0.4 


0.9 


4.1 


24.4 


0.3 


0.4 


0.7 


1.4 


3.0 


12brazil58 


0.1 


0.2 


1.0 


5.8 


37.0 


0.1 


0.3 


0.7 


1.8 


4.3 


20rat99 


0.1 


0.4 


2.2 


10.5 


70.7 


0.1 


0.5 


1.4 


3.2 


8.3 


20krocl00 


0.1 


0.3 


1.6 


12.3 


87.4 


0.2 


0.4 


1.1 


3.7 


9.9 


24grl20 


0.1 


0.6 


2.2 


13.0 


88.5 


0.2 


0.5 


1.4 


3.9 


10.0 


28grl37 


0.1 


0.4 


2.6 


16.1 


121.7 


0.1 


0.5 


1.7 


5.2 


14.9 


31prl52 


0.1 


0.5 


2.7 


13.5 


93.0 


0.2 


0.6 


1.8 


4.1 


10.7 


40dl98 


0.2 


0.7 


3.5 


21.3 


210.6 


0.3 


0.9 


2.5 


6.9 


26.0 


45tsp225 


0.2 


0.9 


4.5 


26.2 


265.2 


0.4 


1.0 


3.0 


8.2 


29.7 


56a280 


0.3 


0.9 


4.7 


28.3 


224.7 


0.4 


1.1 


3.2 


8.9 


27.6 


87gr431 


0.6 


2.2 


11.2 


64.6 


426.0 


0.8 


2.6 


8.2 


22.7 


59.8 


107att532 


0.6 


2.2 


10.7 


62.2 


497.8 


0.8 


2.6 


7.7 


21.4 


67.3 


131p654 


1.0 


3.2 


15.9 


90.9 


578.9 


1.4 


3.9 


11.9 


35.1 


90.0 


200dsjl000 


1.5 


4.8 


21.0 


120.5 


838.1 


1.9 


5.3 


14.2 


38.5 


107.0 


Average 


0.4 


1.3 


6.1 


34.9 


254.6 


0.5 


1.5 


4.2 


11.8 


33.5 



Table A. 10: 2-opt adaptations for GTSP comparison. 



Solution error, % Rimning time, ms 



Instance 


2ob 


20^° 


2ol 


2o£° 


2og 


2ob 


2o|f 


2ol 


2o£° 


2oq 


10att48 


8.5 


6.3 


2.3 


2.3 


2.3 


0.2 


0.2 


0.2 


0.2 


0.3 


12brazil58 


14.0 


2.1 


1.5 


1.5 


1.1 


0.0 


0.0 


0.0 


0.0 


0.1 


20rat99 


22.1 


17.1 


14.5 


13.7 


0.8 


0.0 


0.0 


0.1 


0.1 


0.4 


20kroel00 


15.2 


1.3 


2.7 


2.7 


0.0 


0.0 


0.0 


0.1 


0.1 


0.2 


24grl20 


30.2 


16.8 


8.4 


10.3 


15.2 


0.0 


0.0 


0.2 


0.3 


0.4 


28grl37 


9.6 


2.5 


3.7 


2.7 


1.9 


0.0 


0.1 


0.2 


0.2 


0.7 


31prl52 


9.8 


4.1 


2.4 


2.4 


1.3 


0.0 


0.0 


0.2 


0.2 


0.4 


40dl98 


7.3 


8.7 


3.4 


5.0 


1.5 


0.1 


0.2 


0.6 


0.8 


2.0 


45tsp225 


20.8 


14.0 


9.7 


9.4 


6.8 


0.0 


0.1 


0.6 


0.8 


2.2 


56a280 


26.9 


13.3 


13.3 


10.8 


14.6 


0.1 


0.2 


1.0 


1.1 


3.4 


87gr431 


10.3 


4.8 


7.0 


6.9 


4.2 


0.2 


0.9 


1.3 


1.6 


5.2 


107att532 


16.8 


9.2 


14.7 


14.2 


7.9 


0.2 


0.7 


2.4 


4.1 


8.1 


131p654 


4.1 


6.9 


7.7 


7.7 


4.0 


0.4 


1.7 


3.7 


5.6 


7.9 


200dsjl000 


23.3 


15.7 


16.5 


16.1 


12.9 


1.0 


3.2 


16.5 


20.4 


53.5 


Average 


15.6 


8.8 


7.7 


7.5 


5.3 


0.2 


0.5 


1.9 


2.6 


6.1 
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Table A. 11: Ins adaptations for GTSP comparison. 



Solution error, % Running time, ms 



Instance 


Inspi 


Ins?? 


inSr 


lns¥° 


InSp. 


InSpi 


Ins?? 


inSr 


lns?° 


InSp 




4 7 












n 9 




9 


9 




12brazil58 


15.5 


2.1 


0.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.1 


20rat99 


32.0 


16.5 


4.0 


0.0 


0.0 


0.0 


0.0 


0.1 


0.2 


0.8 


20kroel00 


18.5 


7.7 


6.6 


6.6 


6.6 


0.0 


0.0 


0.1 


0.1 


0.7 


24grl20 


35.1 


20.7 


8.0 


5.7 


2.0 


0.0 


0.0 


0.1 


0.2 


0.6 


28grl37 


9.6 


8.2 


1.9 


7.4 


0.0 


0.0 


0.0 


0.2 


0.3 


1.0 


31prl52 


12.4 


8.2 


6.1 


5.9 


5.9 


0.0 


0.1 


0.3 


0.3 


0.6 


40dl98 


24.6 


21.9 


19.3 


21.6 


15.8 


0.1 


0.1 


0.5 


0.4 


2.9 


45tsp225 


43.4 


24.8 


25.1 


24.6 


15.2 


0.1 


0.2 


0.9 


1.0 


3.2 


56a280 


31.9 


22.3 


23.0 


21.4 


20.9 


0.1 


0.1 


1.0 


0.9 


5.0 


87gr431 


11.0 


7.8 


6.9 


7.1 


6.7 


0.2 


0.4 


2.4 


2.7 


10.2 


107att532 


20.8 


16.7 


13.1 


12.0 


11.6 


0.6 


0.9 


6.3 


7.7 


26.5 


131p654 


23.0 


24.0 


21.7 


21.4 


19.0 


1.5 


2.6 


22.4 


17.1 


58.0 


200dsjl000 


38.7 


30.9 


28.1 


28.4 


27.4 


4.6 


4.5 


53.9 


66.3 


206.3 


Average 


22.9 


15.3 


11.7 


11.6 


9.4 


0.5 


0.7 


6.3 


7.0 


22.6 



Table A.12: GTSP FOfe for different k comparison. 



Solution error, % Running time, ms 



Instance 


FO2 


FO4 


FOe 


FOs 


FOio 


FO2 


FO4 


FOb 


FOs 


FOio 


10att48 


8.2 


0.0 


0.0 


0.0 




0.2 


0.4 


1.4 


7.8 




12brazil58 


2.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.2 


1.8 


10.5 


44.8 


20rat99 


18.5 


17.9 


6.8 


0.8 


0.0 


0.0 


0.4 


3.2 


54.8 


177.8 


20krocl00 


24.3 


24.3 


23.4 


23.4 


0.0 


0.0 


0.3 


3.7 


26.3 


156.0 


24grl20 


34.6 


11.9 


12.4 


0.0 


0.0 


0.0 


0.6 


3.9 


48.9 


187.2 


28grl37 


15.0 


12.8 


2.4 


2.1 


6.3 


0.0 


0.4 


5.2 


38.6 


193.5 


31prl52 


11.0 


7.2 


7.2 


0.7 


0.7 


0.0 


0.5 


4.1 


38.5 


218.4 


40dl98 


29.6 


24.7 


23.9 


15.9 


4.5 


0.1 


0.7 


6.9 


72.7 


508.6 


45tsp225 


43.8 


39.5 


31.5 


24.4 


12.3 


0.1 


0.9 


8.2 


56.0 


468.0 


56a280 


25.4 


25.2 


21.6 


18.1 


18.1 


0.1 


0.9 


8.9 


80.7 


464.9 


87gr431 


11.1 


7.6 


6.6 


6.0 


5.9 


0.2 


2.2 


22.7 


151.4 


892.4 


107att532 


24.0 


22.4 


21.7 


20.6 


13.5 


0.3 


2.2 


21.4 


148.3 


1202.9 


131p654 


33.4 


31.3 


29.4 


27.3 


26.6 


0.4 


3.2 


35.1 


227.9 


1426.0 


200dsjl000 


43.7 


39.1 


37.4 


35.9 


34.3 


0.7 


4.8 


38.5 


267.1 


1822.5 




2.S.2 


18.9 


Ki.O 


12.5 


9.4 


0.2 




11. <S 


87. S 


597.2 
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Tabic A. 13: GTSP local search fair competition. Every cell reports the most successful 
heuristics being given some limited time (see the first column) for a given range of instances 
(see the header). Every heuristic is provided with the average relative solution error in 
percent. To make the table easier to read, all the B and G adaptations of LK are selected 
with bold font. All the cells where the dominating heuristic is C or S are highlighted with 
gray background. 



Tiniest 



Tiny 



Small Moderate Large 



Huge 



Giant 



< 2 ms 



< 5 ms 




31"° 0.0 



Cf ° 0.5 



Cf° 1.2 
Sf° 1.2 



B^^e.l 
B|'=°6.1 
'6.3 
B§'=°6.5 



C^'^" 2.4 



B2co 



7.8 



Bi<=° 



7.3 



2o^°13.4 



El"" 9.5 
Bf'=°9.6 
B§'=10.1 
BMO.3 



22.7 



2o^°14.3 



< 10 ms 






0.8 


Cf° 1.3 


Cf^" 2.9 


r2co 
r2co 


6.1 
6.3 


B§'=°7.9 




< 20 ms li 






Sf ° 0.4 


("3co -[ o 











< 50 ms 

< 0.1 s 

< 0.2 s 



0.2 



Sf ° 0.2 



SI 



0.2 



° 0.0 



S? 2.2 
Sf° 2.2 

Cf ° 1.0 



si™ 2.9 
eg™ 3.0 

Cf ° 1.7 



G§ 0.6 



C^™ 4.0 



Si™ 3.0 
Si™ 1.9 



< 0.5 s 



GK 0.0 



S|™ 1.2 



< 1 s 



Gi 0.4 



Gi 1.0 



Si™ 1.2 



< 2 s 



c4 
->4 



1.0 



< 5 s 
< 10 s 



GK 0.0 Gf 0.8 
— GK 0.0 



Gg 0.8 



< 20 s 



GK 0.1 



GK 0.2 
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Table A. 14: Detailed experiment results for the most successful GTSP heuristics (m < 30). 



Solution error, % Running time, ms 



Instance 


Best 


20b° 


Cf 


c2co 


/-2 
G4 


GK 


2o^° 


Cf 


c2co 




GK 


10att48 


5394 


6.3 


0.0 


0.0 


0.0 


0.0 


0.24 


0.25 


0.28 


2.53 


18.72 


10gr48 


1834 


4.9 


0.0 


0.0 


0.0 


0.0 


0.01 


0.03 


0.06 


1.45 


12.48 


10hk48 


6386 


0.0 


0.3 


0.0 


0.0 


0.0 


0.01 


0.08 


0.17 


1.36 


18.72 


llcil51 


174 


4.0 


0.6 


0.0 


0.0 


0.0 


0.01 


0.04 


0.13 


1.23 


17.16 


llberlin52 


4040 


0.0 


0.0 


0.4 


0.0 


0.0 


0.01 


0.06 


0.12 


1.17 


12.48 


12brazil58 


15332 


2.1 


0.0 


0.0 


0.0 


0.0 


0.01 


0.06 


0.11 


1.67 


12.48 


14st70 


316 


6.3 


0.0 


0.3 


0.0 


0.0 


0.02 


0.07 


0.16 


3.18 


21.84 


ioeilYD 


zU9 


4.8 


0.0 


O.U 


0.0 


0.0 


O.Ul 


O.Uo 


0.23 


4.23 


01 OA 

21.04 


16pr76 


64925 


1.6 


1.4 


0.0 


0.0 


0.0 


0.02 


0.11 


0.27 


4.10 


26.52 


20gr96 


29440 


2.4 


1.0 


0.0 


0.0 


0.0 


0.03 


0.22 


0.42 


9.09 


28.08 


20rat99 


497 


7.8 


0.2 


0.0 


0.0 


0.0 


0.03 


0.24 


0.64 


15.05 


37.44 


20kroal00 


9711 


4.2 


5.8 


0.0 


0.0 


0.0 


0.03 


0.17 


0.46 


14.59 


31.20 


20krobl00 


10328 


0.0 


0.0 


0.0 


0.0 


0.0 


0.01 


0.10 


0.36 


15.64 


28.08 


20krocl00 


9554 


10.1 


0.1 


0.0 


0.0 


0.0 


0.03 


0.17 


0.54 


8.05 


31.20 


20krodl00 


9450 


1.5 


0.0 


2.0 


0.0 


0.0 


0.05 


0.17 


0.44 


10.12 


39.00 


20krocl00 


9523 


1.3 


4.4 


0.0 


0.0 


0.0 


0.03 


0.15 


0.37 


8.33 


31.20 


20rdl00 


3650 


7.1 


0.1 


0.9 


0.0 


0.0 


0.03 


0.15 


0.53 


18.02 


34.32 


21eill01 


249 


4.4 


0.4 


0.8 


0.4 


0.0 


0.02 


0.16 


0.30 


7.24 


43.68 


211inl05 


8213 


0.1 


0.0 


0.0 


0.0 


0.0 


0.02 


0.14 


0.36 


5.50 


32.76 


22prl07 


27898 


4.4 


0.0 


0.0 


0.0 


0.0 


0.01 


0.23 


0.42 


24.48 


31.20 


24grl20 


2769 


20.5 


2.8 


2.6 


0.0 


0.0 


0.03 


0.24 


0.77 


10.77 


43.68 


25prl24 


36605 


4.5 


0.0 


0.5 


0.0 


0.0 


0.05 


0.39 


0.81 


14.76 


46.80 


26bierl27 


72418 


6.9 


8.6 


0.0 


0.0 


0.0 


0.08 


0.36 


0.69 


12.45 


54.60 


26chl30 


2828 


12.1 


0.0 


0.0 


0.0 


0.0 


0.09 


0.24 


0.71 


18.14 


48.36 


28prl36 


42570 


9.7 


0.8 


0.0 


0.0 


0.0 


0.04 


0.49 


0.77 


14.24 


49.92 


28grl37 


36417 


1.9 


1.4 


1.3 


0.1 


0.0 


0.04 


0.27 


0.97 


62.66 


51.48 


29prl44 


45886 


4.0 


0.0 


0.0 


0.0 


0.0 


0.03 


0.36 


0.58 


15.31 


40.56 


Average 




4.9 


1.0 


0.3 


0.0 


0.0 


0.04 


0.19 


0.43 


11.31 


32.07 
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Table A. 15: Detailed experiment results for the most successful GTSP heuristics (m > 30). 
The reported values are relative solution errors, %. 



Instance 


Best 


2oF° 

D 




(-2CO 


S2CO 


gSco 


g4co 


54^^° 




GK 


30chl50 


2750 


6.5 


7.1 


1.7 


1.1 


0.0 


0.0 


0.3 


1.1 


0.0 


30kroal50 


11018 


16.2 


8.2 


0.1 


1.6 


0.0 


0.0 


0.0 


0.0 


0.0 


30krobl50 


12196 


5.4 


5.4 


0.0 


1.0 


0.0 


0.5 


0.0 


0.0 


0.0 


31prl52 


51576 


4.1 


3.3 


3.9 


1.9 


0.0 


0.0 


0.0 


1.2 


0.0 


32ul59 


22664 


24.9 


10.2 


0.8 


0.4 


0.0 


0.0 


0.0 


1.1 


0.0 


35sil75 


5564 


2.6 


3.8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


36brgl80 


4420 


314.5 


314.5 


0.5 


78.3 


0.0 


0.0 


0.0 


0.0 


0.0 


39ratl95 


854 


7.6 


12.5 


1.4 


2.0 


0.2 


1.3 


0.1 


0.0 


0.0 


40dl98 


10557 


1.3 


3.5 


1.3 


0.3 


0.0 


0.5 


0.0 


0.2 


0.0 


40kroa200 


13406 


8.3 


4.8 


0.6 


0.4 


0.4 


0.4 


0.4 


0.0 


0.0 


40krob200 


13111 


14.6 


14.0 


0.1 


2.7 


0.2 


0.1 


0.0 


0.0 


0.0 


41gr202 


23301 


10.5 


7.1 


3.1 


4.3 


2.5 


1.9 


0.0 


0.0 


0.0 


45ts225 


68340 


7.2 


6.8 


0.1 


0.3 


0.3 


0.1 


0.3 


0.1 


0.0 


45tsp225 


1612 


12.3 


6.6 


0.6 


1.0 


1.9 


0.3 


0.3 


0.0 


0.0 


46pr226 


64007 


14.2 


1.1 


1.1 


1.1 


0.0 


0.0 


0.0 


0.0 


0.0 


46gr229 


71972 


7.6 


8.1 


1.2 


1.0 


0.0 


0.0 


0.0 


0.9 


0.0 


53gil262 


1013 


20.6 


11.1 


3.6 


0.7 


0.8 


0.7 


0.0 


0.2 


0.0 


53pr264 


29549 


9.9 


0.7 


0.8 


0.8 


1.0 


0.4 


0.2 


0.5 


0.0 


56a280 


1079 


5.9 


3.3 


2.3 


0.8 


0.3 


0.3 


0.0 


0.6 


0.0 


60pr299 


22615 


8.0 


4.0 


3.9 


1.0 


0.2 


0.0 


0.0 


0.1 


0.0 


641in318 


20765 


10.1 


8.3 


3.7 


2.5 


0.9 


0.0 


0.0 


2.6 


0.0 


80rd400 


6361 


11.4 


7.9 


2.3 


1.3 


2.8 


1.1 


2.0 


0.7 


0.0 


8411417 


9651 


0.5 


1.5 


1.8 


1.6 


0.5 


0.0 


0.1 


0.0 


0.0 


87gr431 


101946 


5.1 


5.2 


2.6 


3.2 


3.6 


2.5 


1.1 


0.0 


0.0 


88pr439 


60099 


9.7 


5.9 


1.8 


1.2 


1.4 


1.3 


0.0 


1.1 


0.0 


89pcb442 


21657 


7.8 


5.5 


2.9 


0.1 


1.0 


0.0 


1.7 


2.1 


0.0 


99d493 


20023 


8.3 


5.8 


2.1 


3.3 


2.4 


0.7 


1.4 


2.3 


0.0 


107ah535 


128639 


15.9 


5.0 


3.1 


2.6 


0.5 


0.0 


0.4 


0.5 


0.0 


107att532 


13464 


11.3 


5.6 


0.8 


1.5 


0.5 


0.8 


0.1 


0.1 


0.0 


107si535 


13502 


2.4 


1.3 


0.3 


0.1 


0.1 


0.0 


0.0 


0.3 


0.0 


113pa561 


1038 


10.7 


6.3 


1.4 


2.9 


1.7 


1.6 


1.6 


0.6 


0.0 


1 1 'ill ^1 74 




10.4 




5 7 


5 1 




1.1 




1 6 


f) 


115rat575 


2388 


13.4 


11.5 


4.4 


4.2 


3.5 


3.2 


3.2 


1.3 


0.2 


131p654 


27428 


2.0 


1.4 


0.3 


2.5 


0.2 


0.0 


0.0 


0.2 


0.0 


132d657 


22498 


10.6 


9.5 


4.6 


3.9 


1.7 


1.6 


0.5 


1.9 


0.1 


134gr666 


163028 


10.7 


5.7 


2.2 


2.4 


1.9 


2.5 


2.0 


1.0 


0.2 


145u724 


17272 


12.5 


13.1 


4.6 


2.3 


1.3 


2.9 


0.3 


1.3 


0.0 


157rat783 


3262 


19.7 


12.9 


4.7 


2.9 


3.5 


0.3 


1.6 


1.3 


0.1 


200dsjl000 


9187884 


14.8 


8.9 


4.3 


4.4 


0.8 


1.5 


1.9 


2.6 


0.1 


201prl002 


114311 


16.3 


8.4 


3.6 


0.2 


0.2 


1.5 


0.8 


0.1 


0.2 


207sil032 


22306 


5.2 


4.1 


1.7 


1.2 


0.9 


0.1 


0.1 


0.9 


0.0 


212ul060 


106007 


13.7 


9.0 


3.6 


2.3 


1.8 


1.7 


2.1 


0.7 


0.2 


217vml084 


130704 


12.4 


8.2 


3.1 


3.0 


2.2 


2.0 


2.1 


1.8 


0.3 


Average 




17.1 


13.9 


2.2 


3.6 


1.0 


0.8 


0.6 


0.7 


0.0 


Light avg. 




11.4 


7.6 


2.5 


2.0 


1.1 


0.9 


0.7 


0.8 


0.0 






42.. S 


41.:-! 


0.8 


10. (i 


().:-! 


0.1 


0.1 


0.:-! 


0.0 
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Table A. 16: Detailed experiment results for moderate and large instances (m > 30). The 
reported values are running times, ms. 



Instance 


2oF° 

D 


31"° 


(-2CO 


S2CO 


S3co 


g4co 






GK 


30clil50 


0.1 


0.1 


0.5 


1.4 


2.8 


2.7 


8.0 


46.7 


56.2 


30kroal50 


0.0 


0.1 


0.4 


1.0 


1.8 


4.0 


4.2 


32.3 


57.7 


30krobl50 


0.0 


0.1 


0.4 


1.2 


1.5 


2.5 


7.0 


50.6 


65.5 


31prl52 


0.0 


0.2 


0.4 


1.4 


4.5 


25.3 


33.4 


38.8 


39.0 


32ul59 


0.1 


0.1 


0.3 


0.9 


2.7 


4.2 


25.7 


31.9 


62.4 


35sil75 


0.1 


0.2 


1.8 


3.6 


10.0 


23.5 


358.8 


232.5 


64.0 


36brgl80 


0.0 


0.2 


0.4 


0.4 


1.2 


2.3 


279.3 


46.4 


53.0 


39ratl95 


0.1 


0.1 


0.7 


1.2 


3.1 


7.3 


13.7 


64.9 


138.8 


40dl98 


0.2 


0.6 


2.0 


3.7 


21.9 


134.2 


310.4 


98.7 


126.4 


40kroa200 


0.1 


0.1 


0.7 


1.6 


3.2 


4.1 


11.7 


60.6 


123.2 


40krob200 


0.1 


0.2 


0.5 


1.4 


2.4 


4.2 


16.2 


56.3 


157.6 


41gr202 


0.1 


0.3 


0.8 


1.9 


7.8 


11.0 


81.2 


86.1 


198.1 


45ts225 


0.1 


0.3 


0.7 


3.0 


8.0 


10.0 


19.9 


273.0 


191.9 


45tsp225 


0.1 


0.2 


0.8 


2.3 


3.1 


7.6 


15.5 


112.3 


156.0 


46pr226 


0.1 


0.4 


1.0 


1.9 


4.5 


12.7 


21.7 


44.1 


95.2 


46gr229 


0.1 


0.2 


1.0 


3.2 


3.5 


8.8 


13.9 


145.1 


224.6 


53gil262 


0.2 


0.3 


1.9 


3.8 


7.9 


9.2 


21.3 


107.8 


290.2 


53pr264 


0.2 


1.0 


5.7 


6.5 


66.2 


282.4 


505.4 


230.9 


204.4 


56a280 


0.2 


0.3 


1.1 


2.2 


11.2 


9.3 


43.9 


148.2 


291.7 


60pr299 


0.1 


0.2 


1.5 


3.8 


8.7 


12.6 


31.4 


146.7 


347.9 


641in318 


0.2 


0.3 


2.0 


4.2 


17.3 


48.6 


81.4 


223.1 


404.0 


80rd400 


0.3 


0.7 


3.8 


5.6 


18.2 


36.7 


74.4 


305.8 


872.0 


8411417 


0.3 


2.3 


5.9 


9.7 


59.0 


174.8 


315.1 


645.8 


583.4 


87gr431 


0.4 


0.8 


4.4 


9.3 


19.8 


59.6 


107.9 


485.2 


1673.9 


88pr439 


0.3 


0.8 


3.0 


11.6 


24.4 


54.3 


109.3 


764.4 


1146.6 


89pcb442 


0.5 


0.8 


4.1 


9.5 


23.1 


42.9 


88.8 


656.8 


1530.4 


99d493 


0.7 


2.0 


7.5 


13.1 


148.3 


2666.1 


1616.2 


591.2 


3675.4 


107ali535 


1.0 


2.3 


7.1 


13.4 


29.9 


52.2 


170.2 


795.6 


3558.4 


107att532 


0.6 


1.9 


8.0 


17.1 


33.1 


71.5 


312.1 


932.9 


2942.2 


107si535 


0.5 


5.5 


32.9 


46.7 


337.0 


1921.9 


12725.0 


3503.8 


1449.2 


113pa561 


0.7 


1.3 


5.4 


11.6 


28.6 


51.0 


104.2 


695.8 


2931.3 


1 1 'ill ^1 74 


7 


J- . u 


fi 8 


1 7 


53 3 


63 9 




956 3 


301 7 1 


115rat575 


0.5 


1.3 


6.4 


17.9 


41.0 


92.9 


128.0 


697.3 


2867.3 


131p654 


1.2 


9.4 


40.9 


27.3 


213.9 


1074.8 


2964.0 


3293.2 


2137.2 


132d657 


0.9 


2.3 


13.6 


22.0 


109.4 


1009.3 


2322.9 


794.0 


4711.2 


134gr666 


1.0 


2.3 


8.7 


28.1 


51.5 


135.9 


374.4 


1425.8 


10698.6 


145u724 


1.0 


2.7 


13.4 


32.6 


62.8 


105.8 


242.0 


1326.0 


7952.9 


157rat783 


1.5 


2.2 


17.7 


30.8 


73.7 


131.3 


248.3 


2165.3 


9459.9 


200dsjl000 


3.5 


10.3 


80.7 


104.5 


592.8 


5199.5 


8032.5 


9361.6 


22704.4 


201prl002 


2.3 


6.2 


39.1 


57.0 


156.4 


290.6 


539.8 


2719.1 


21443.9 


207sil032 


3.5 


37.4 


839.3 


875.2 


7063.7 


195644.0 


306944.8 


112926.4 


17840.3 


212ul060 


3.7 


7.1 


36.4 


80.2 


195.5 


307.5 


1040.5 


2990.5 


31201.8 


217vml084 


2.5 


6.6 


51.4 


78.5 


204.8 


496.1 


978.1 


4687.8 


27587.2 


Average 


0.7 


2.6 


29.3 


36.3 


226.4 


4890.9 


7941.8 


3604.6 


4310.1 


Light avg. 


0.7 


1.6 


9.5 


16.8 


56.0 


315.7 


488.5 


972.0 


4653.6 


H(>;u"\- a\"g. 


0.8 


7.1 


116. 1 


121. (i 


971.6 


24907.:-! 


40.^)50.4 


1.1122.2 


2S07.2 
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Table A. 17: MAP construction heuristics comparison. 







Solution 


error, % 






Running times, ms 




Inst. Best 


Trivial Greedy Max-Regret ROM 


Trivial Greedy Max-Regret ROM 




157 


6 


6 


10 





40 


799 


9 


3rl50 150.0 


A QQ7 




zy 


'iA 



u 


14 


^ zoo 


zu 


4gp30 145.2 


158 


9 


9 


2 





35 


206 


7 


'^loU OU-U 


4 985 


74 


49 


76 





12 


27 285 


278 


5gpl2 66.2 


147 


13 


9 


9 





6 


36 


2 


5r40 40.0 


4911 


159 


116 


169 





6 


37 214 


686 


6gp8 41.8 


143 


25 


1 


14 





5 


33 


2 


6r22 22.0 


5180 


295 


218 


310 





6 


24 750 


861 


7gp5 25.6 


157 


27 


6 


20 





1 


8 


1 


7rl4 14.0 


lib 


Oil 


/I c; /I 


oyO 


u 


Z 


1 1 Uoz 


oUo 


8gp4 19.2 


1 1 Q 


zl 


J_ 


Zo 


U 


1 


o 
O 


1 


ory y.u 




o / y 






U 


o 
Z 


c; An/1 


Q/l O 

o4z 


All avg. 


2 610 


137 


118 


134 





11 


9 769 


252 


vjr I <iVg. 


146 


17 


6 


14 





15 


182 


4 


R,a.nd. a.vg. 


5 075 


256 


230 


255 





7 


19356 


500 


3-AP avg. 


2 577 


30 


17 


22 





27 


2 526 


17 


4-AP avg. 


2 571 


41 


29 


39 





23 


13 745 


142 


5-AP avg. 


2 529 


86 


62 


89 





6 


18 625 


344 


6-AP avg. 


2 662 


160 


110 


162 





5 


12 391 


432 


7-AP avg. 


2 637 


202 


230 


208 





2 


8 520 


403 


8-AP avg. 


2 687 


300 


261 


286 





1 


2 806 


171 


3cql50 1738.5 


1219 


41 


20 


37 





56 


4388 


27 


3gl50 1552.0 


865 


19 


27 


3 





53 


4 226 


28 


3pl50 14437.2 


76 


215 


122 


7 





580 


4 318 


37 


3srl50 1077.8 


1250 


42 


21 


43 





60 


4 363 


29 


4cq50 3034.8 


400 


27 


22 


32 





156 


3 713 


161 


4g50 1705.2 


492 


21 


29 


2 





217 


3 828 


148 


4p50 20096.8 


103 


484 


278 


8 





1030 


3 725 


151 


4sr50 1496.6 


367 


25 


20 


32 





193 


3 847 


150 


5cq30 4727.1 


218 


20 


11 


24 





640 


9636 


583 


5g30 2321.8 


340 


26 


33 


3 





936 


9 650 


604 


5p30 55628.5 


137 


1017 


646 


8 





2 711 


9 536 


619 


5sr30 1842.0 


196 


16 


13 


28 





666 


9 627 


615 


6rnl8 5765 5 


142 


15 


15 


18 





426 


6 758 


267 


6gl8 2536.0 


260 


26 


27 


3 





563 


6 802 


262 


6pl8 135515.3 


163 


2 118 


1263 


8 





1098 


6 758 


323 


fieri R 1 9i^fi 


121 




1 

i-O 


1 Q 

-Ly 


n 
u 


420 


'J t 1 o 


261 




91 


14 


11 


15 





1037 


6 653 


924 


( 3-LZ OZU 1 .Z 


156 


19 


23 


2 





1217 


6 614 


944 


7pl2 558611.7 


346 


3162 


1994 


9 





1872 


6 463 


335 


7srl2 1795.7 


78 


9 


9 


15 





980 


6 510 


268 


8cq8 7004.9 


62 


10 


10 


10 





465 


2 416 


130 


8g8 3679.5 


105 


15 


21 


1 





569 


2 446 


120 


8p8 2233760.0 


177 


3 605 


2 309 


9 





710 


2 413 


140 


8sr8 1622.1 


52 


7 


7 


10 





474 


2 448 


132 


All avg. 


309 


457 


290 


14 





714 


5 580 


302 


Clique avg. 


355 


21 


16 


23 





463 


5 594 


349 


Gcom. avg. 


370 


21 


27 


2 





593 


5 594 


351 


Product avg. 


167 


1767 


1 102 


8 





1334 


5 536 


268 


SR avg. 


344 


19 


M 


24 





465 


5 595 


242 


3-AP avg. 


853 


79 


47 


22 





187 


4 324 


30 


4-AP avg. 


340 


139 


87 


19 





399 


3 778 


152 


5-AP avg. 


223 


270 


177 


15 





1238 


9612 


605 


6-AP avg. 


171 


543 


329 


12 





627 


6 773 


278 


7-AP avg. 


168 


801 


509 


10 





1276 


6 560 


618 


8-AP avg. 


99 


909 


587 


8 





555 


2 431 


131 
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Table A. 18: Solution errors of MAP local search heuristics started from Trivial. 



Solution error, % 



Inst. 


Best 


2-opt 3-opt 


v-opt 


IDV 


2DV 


sDV 


IDV2 


2DV2 


sDVs 


sDVv 


Qo-ni on 


504.4 


19.6 


10.0 


19.8 


4.9 


4.9 


4.9 


4.9 


4.9 


4.6 


4.9 


3rl50 


150.0 


134.5 


16.0 


1.5 




2A 


2A 


2.4 


2.4 


2.1 


0.7 


4gp30 


145.2 


17.4 


4.2 


13.4 


11.1 


7.9 


7.9 


10.7 


7.9 


42 


7.5 


4r80 


80.0 


115.0 


7.3 


2.0 


20.5 


11.5 


11.5 


18.9 


11.5 


4.1 


1.6 


5gpl2 


66.2 


10.6 


2.1 


8.5 


12.5 


09 


6J) 


10.1 


6.9 


M 


6.9 


5r40 


40.0 


104.5 


4.3 


3.8 


63.0 


34.3 


34.3 


47.3 


34.3 




5.3 


6gp8 


41.8 


6.7 


2.4 


5.3 


12.4 


5.7 


5M 


6.5 


5.5 


2.4 


4.8 


6r22 


22.0 


105.5 


0.9 


8.6 


125.0 


62.3 


54.5 


80.9 


55.5 


L8 


9.1 


7gp5 


25.6 


u.o 


o.y 


10 2 


21 5 


Q n 
y.u 


u.y 


u.y 


^ 1 


o.y 


u.o 


7rl4 


14.0 


yo. ( 


n n 
u.u 


36.4 


244.3 


111.4 


72.1 


92.1 


70.0 


07 


16.4 


SgP'l 


19.2 


u.o 


. J. Z 


10.9 


17.2 


9.4 


6.2 


7.8 


6.8 


5.2 


6.2 


8r9 


9.0 




U.VJ 


()7.<s 


:-!2:?.:i 


IV:?. :i 


()0,0 


7:-!,:i 


77, S 


0.0 


40.0 


All avg. 




58.6 




15.7 


71.5 


36.6 


22.6 


30.1 


24.0 


2S 


9.1 


GP avg. 




11.2 


4.6 


11.3 


13.3 


7.3 


6.1 


7.6 


6.2 


3.7 


6.0 


Rand. avg. 


106.1 


4.7 


20.0 


129.8 


65.9 


39.1 


52.5 


41.9 


2.0 


12.2 


3-AP avg. 




77.1 


13.0 


10.6 


3.6 


3.6 


3.6 


3.6 


3.6 


3.3 


2.8 


4-AP avg. 




66.2 


5.7 


7.7 


15.8 


M. 


07 


14.8 


9.7 


4.2 


4.6 


5-AP avg. 




57.5 


3.2 


6.1 


37.8 


20.6 


20.6 


28.7 


20.6 




6.1 


6-AP avg. 




56.1 


1.7 


6.9 


68.7 


34.0 


29.8 


43.7 


30.5 


2.1 


6.9 


7-AP avg. 




51.0 


2.0 


23.3 


132.9 


60.2 


39.0 


49.0 


37.5 


2.3 


10.9 


8-AP avg. 




43.9 


2.6 


39.4 


170.3 


91.4 


33.1 


40.6 


42.3 


M 


23.1 


3cql50 


1738.5 


125.1 


49.9 


22.8 


20.1 


20.1 


20.1 


20.1 


20.1 


19.9 


18.9 


3gl50 


1552.0 


0.0 


0.0 


5.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3pl50 


14437.2 


0.1 


0.0 


15.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3srl50 


1077.8 


144.2 


64.0 


28.0 


22.0 


22.0 


22.0 


22.0 


22.0 


21.8 


21.3 


4cq50 


3034.8 


52.5 


31.3 


30.3 


23.3 


23.1 


23.1 


23.2 


23.1 


21.4 


20.1 


4g50 


1705.2 


0.0 


0.0 


11.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4p50 


20096.8 


0.0 


0.0 


49.6 


0.1 


0.0 


0.0 


0.1 


0.0 


0.0 


0.0 


4sr50 


1496.6 


56.8 


30.6 


31.9 


27.2 


24.8 


24.8 


27.2 


24.8 


23.4 


23.9 


5cq30 


4727.1 


30.9 


18.7 


21.4 


16.9 


16.6 


16.6 


16.8 


16.6 


15.5 


16.1 


5g30 


2321.8 


M 


00 


9.2 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


5p30 


55628.5 


0.0 


00 


53.2 


0.1 


OJ) 


OO 


0.0 


0.0 


00 


0.0 


5sr30 


1842.0 


38.3 


19.0 


23.9 


21.7 


20.4 


20.4 


21.1 


20.4 


17.6 


18.3 


6cql8 


5765.5 


17.6 


12.2 


16.1 


11.5 


10.3 


11.6 


11.3 


10.3 


10.1 


11.1 


6gl8 


2536.0 


0.0 


0.0 


15.4 


0.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6pl8 135515.3 


0.0 


0.0 


98.3 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


6srl8 


1856.3 


20.9 


11.9 


17.4 


12.7 


13.9 


13.6 


12.7 


13.9 


11.5 


12.6 


7cql2 


6663.7 


11.9 


5.3 


10.4 


8.0 


7.0 


5.9 


7.1 


6.9 


5.7 


5.8 


7gl2 


3267.2 


0.0 


0.0 


9.9 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7pl2 558611.7 


0.0 


OO 


123.6 


0.2 


0.0 


OO 


0.0 


0.0 


00 


0.0 


7srl2 


1795.7 


12.1 


7.6 


11.0 


8.5 


10.1 


7.1 


8.3 


10.1 




7.0 


ScqS 


7004.9 


6.4 


3.0 


8.5 


6.4 


4.4 


4.8 


5.3 


4.1 


2.2 


4.7 


8g8 


3679.5 


0.0 


0.0 


9.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8p8 2233760.0 


0.0 


(LO 


143.8 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8sr8 


1622.1 


6.6 


M 


7.4 


5.7 


5.0 


47 


4.9 


4.4 




4.7 


All avg. 




21.8 


10.7 


32.2 


7.8 


7.4 


L3 


7.5 


7.4 


06 


6.9 


Clique avf 




40.7 


20.0 


18.2 


14.4 


13.6 


13.7 


14.0 


13.5 


12.5 


12.8 


Gcom. avg. 


(U) 


OO 


10.1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


Product avg. 


0.0 


OO 


80.6 


0.1 


0.0 


OO 


0.0 


0.0 


0.0 


0.0 


SR avg. 




46.5 


22.6 


19.9 


16.3 


16.1 


15.4 


16.0 


16.0 


13.9 


14.7 


3-AP avg. 




67.3 


28.5 


17.9 


10.5 


10.5 


10.5 


10.5 


10.5 


10.4 


10.1 


4-AP avg. 




27.3 


15.5 


30.7 


12.7 


12.0 


12.0 


12.6 


12.0 


11.2 


11.0 


5-AP avg. 




17.3 


9.4 


26.9 


9.7 


9.3 


9.3 


9.5 


9.3 


8.3 


8.6 


6-AP avg. 




9.6 


OO 


36.8 


6.2 


Ol 


6.3 


6.0 


6.1 


5A 


6.0 


7-AP avg. 




6.0 


M 


38.7 


4.2 


4.3 




3.8 


4.3 


2.9 


3.2 


8-AP avg. 




3.2 


1.4 


42.2 


3.1 


2.4 


2.4 


2.6 


2.1 


1.4 


2.4 
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Table A. 19: Running times of MAP local search heuristics started from Trivial. 



Running time, ms 



Inst. 


2-opt 


3-opt 


v-opt 


IDV 


2DV 


sDV 


IDV2 


2DV2 


sDVs 


sDVv 


^o-rti on 


6.2 


820.6 


181.8 


14.3 


14.0 


16.5 


18.4 


16.7 


430.6 


79.0 


3rl50 


19.8 


1 737.9 


65.7 


17.6 




17.1 


22.7 


18.9 


147.8 


45.4 


4gp30 


1.5 


150.3 


45.0 


0.7 


1.2 


1.1 


L4 


1.4 


116.9 


17.5 


4r80 


10.5 


987.5 


64.5 


7.9 


18.0 


15.3 


11.2 


18.4 


344.8 


98.2 


5gpl2 




38.5 


3.6 


02 


0.4 


0.5 


05 


0.5 


,30.6 


1.6 


5r40 


16.9 


425.9 


34.3 


2.3 


7.2 


6.3 


4.6 


8.6 


.386.9 


35.3 


6gp8 


02 


57.2 


2.5 


02 


0.3 


0.4 


04 


0.5 


42.0 


1.3 


6r22 


2.2 


218.9 


16.7 


09 


2.6 


3.9 


L9 


4.3 


259.0 


22.7 


7gp5 


1 


48 9 


n Q 
u.y 


n 1 

U. 1 


n 9 




n 1 

U. 1 


u.o 




n Q 
u.y 


7rl4 


1.1 


237.1 


12.0 


04 


1.6 


2.9 


L8 


3.0 


210.9 


15.5 


8gp4 


0.1 


117.5 


0.8 


0.2 


0.3 


0.6 


0.2 


0.3 


72.3 


0.9 


8r9 


0,9 


lOl.O 


(),T 


0.:i 


1.1 




1.0 




17V. 7 


7.1 


All avg. 


M 


419.4 


36.2 




5.5 


5.6 




6.3 


188.3 


27.1 


GP avg. 


1.4 


205.5 


39.1 


2.6 


2.7 


3.2 


3.5 


3.3 


122.1 


16.9 




8.6 


633.2 


33.3 


4.9 


8.2 


7.9 


7.2 


9.4 


254.5 


37.4 


3-AP avg. 


13.0 


1 279.2 


123.8 


16.0 


16.4 


16.8 


20.5 


17.8 


289.2 


62.2 


4^AP avg. 




568.9 


54.7 


4^ 


9.6 


8.2 




9.9 


230.8 


57.8 


5-AP avg. 


M 


232.2 


19.0 


1.3 


3.8 


3.4 


2^ 


4.5 


208.7 


18.5 


6-AP avg. 


1.2 


138.1 


9.6 


05 


1.5 


2.1 


1.1 


2.4 


150.5 


12.0 


7-AP avg. 


0.7 


143.0 


6.5 


0.3 


0.9 


1.6 


1.0 


1.6 


125.5 


8.2 


8-AP avg. 


05 


154.7 


3.8 


03 


0.7 


1.4 


06 


1.7 


125.0 


4.0 


3cql50 


22.1 


4 366.5 


1388.4 


42.1 


39.3 


34.9 


41.0 


46.0 


1503.9 


497.6 


3gl50 


19.0 


2 229.3 


780.0 


26.2 


28.1 


25.5 


37.2 


33.0 


1299.5 


201.2 


3pl50 


15.4 


2 149.7 


847.1 


82.0 


89.8 


89.7 


96.0 


101.9 


1730.1 


458.6 


3srl50 


21.7 


3 949.9 


1 157.5 


36.0 


37.5 


37.9 


41.2 


47.1 


1 400.9 


469.6 


4cq50 


6A 


872.0 


308.9 


3.8 


8.5 


7.3 


6.1 


10.8 


468.0 


167.2 


4g50 


5.3 


542.9 


251.2 


3.7 


5.9 


5.9 


6.7 


6.6 


273.0 


87.3 


4p50 


5.7 


586.6 


251.2 


7.3 


14.2 


13.6 


13.4 


15.7 


441.5 


95.5 


4sr50 


5.6 


1 009.3 


296.4 


3.3 


7.4 


6.2 


6.0 


7.9 


424.3 


111.6 



5cq30 


4.6 


1087.3 


177.7 


2.0 


5.2 


5.5 


3.3 


6.0 


560.0 


63.5 


5g30 




673.9 


182.5 


1.8 


4.1 


4.0 




5.7 


319.8 


41.8 


5p30 


4.5 


762.8 


103.6 


2.7 


10.1 


9.5 


6.1 


12.2 


580.3 


44.1 


5sr30 




1 115.4 


163.5 




4.7 


4.5 




6.3 


667.7 


63.2 


6cql8 


3.5 


1205.9 


63.4 


1.0 


2.7 


3.7 


1.5 


3.1 


630.2 


26.6 


6gl8 


M 


731.6 


55.2 


09 


1.8 


2.7 


L9 


2.4 


346.3 


18.1 


6pl8 


3.1 


929.8 


31.1 


1.3 


3.8 


5.4 


2.5 


5.2 


658.3 


19.9 


6srl8 




1 ,369.7 


59.9 


09 


2.9 


3.0 


L5 


3.4 


778.4 


34.4 


7cql2 


hi 


1658.3 


31.7 


0.6 


2.0 


3.4 


1.2 


2.9 


728.5 


12.6 


7gl2 


1.4 


1 048.3 


28.2 


0.6 


1.3 


2.4 


1.1 


2.0 


555.4 


11.1 


7pl2 


2.1 


1 ,324.4 


17.5 


0.8 


2.4 


6.4 


L8 


3.9 


1088.9 


14.6 


7srl2 


L9 


1 622.4 


40.9 


0.7 


2.0 


3.5 


1.1 


2.5 


965.6 


11.0 


8cq8 


1.1 


2112.3 


13.3 


05 


1.5 


2.8 


1.0 


2.0 


1909.5 


8.5 


8g8 


1.0 


1 675.5 


15.6 


0.4 


0.8 


2.1 


08 


1.2 


728.5 


7.2 


8p8 


LI 


2 051.4 


7.6 


04 


1.2 


3.1 


09 


1.8 


1492.9 


7.9 


8sr8 


L3 


2 439.9 


16.4 


03 


1.3 


2.9 


LO 


1.8 


1252.7 


8.1 


All avg. 


5J3 


1563.1 


262.0 


02 


11.6 


11.9 


11.7 


13.8 


866.8 


103.4 


Clique avg. 


6.5 


1883.7 


330.6 


8.3 


9.9 


9.6 


9.0 


11.8 


966.7 


129.4 


Gcom. avg. 


5A 


1 150.2 


218.8 


5J) 


7.0 


7.1 


8.5 




587.1 


61.1 


Product avg. 


5.4 


1 300.8 


209.7 


15.8 


20.2 


21.3 


20.1 


23.4 


998.7 


106.8 


SR avg. 




1917.8 


289.1 


7^ 


9.3 


9.7 


9A 


11.5 


914.9 


116.3 


3-AP avg. 


19.5 


3173.8 


1 013.3 


16.6 


48.7 


47.0 


53.8 


57.0 


1 483.6 


406.8 


4-AP avg. 


5Ji 


752.7 


276.9 




9.0 


8.2 




10.2 


401.7 


115.4 


5-AP avg. 


AA 


909.9 


156.8 


2.1 


6.0 


5.9 


4.2 


7.5 


532.0 


53.2 


6-AP avg. 


2.7 


1059.2 


52.4 


ho 


2.8 


3.7 


L9 


3.5 


603.3 


24.8 


7-AP avg. 


hi 


1413.4 


29.6 


0.7 


1.9 


3.9 


1.3 


2.8 


834.6 


12.3 


8-AP avg. 


1.2 


2 069.7 


13.2 


0.4 


1.2 


2.7 


0.9 


1.7 


1 345.9 


7.9 



A. Tables 



189 



Table A. 20: Solution errors of MAP local search heuristics started from Greedy. 



Solution error, % Running times, ms 

Inst. 2-opt IDV 2DV sDV IDV2 2DV2 sDVs sDVv 2-opt IDV 2DV sDV IDV2 2DV2 sDVs sDVv 



3gpl00 


4.3 


3.4 


3.4 


3 


4 


3.4 


3.4 


3 


3 


3 


4 





04 


0.04 


0.04 





04 





05 





05 





36 





09 


3rl50 


16.7 


1.2 


1.2 


1 


2 


1.2 


1.2 





8 





7 





02 


0.02 


0.02 





03 





02 





03 





11 





05 


4gp30 


4.5 


3.7 


3.6 


3 


6 


3.6 


3.6 


2 


6 


3 


6 





04 


0.03 


0.04 





04 





04 





04 





11 





05 


4r80 


15.8 


7.9 


6.1 


6 


1 


7.9 


6.1 


2 


6 


1 


5 





01 


0.02 


0.02 





02 





02 





02 





21 





08 


5gpl2 


5.4 


6.3 


4.5 


4 


5 


5.3 


4.5 


i 


8 


4 


5 





01 


0.01 


0.01 





01 





01 





01 





03 





01 


5r40 


18.5 


19.8 


13.5 


13 


5 


15.0 


13.5 


2 


3 


3 


5 





01 


0.01 


0.01 





01 





01 





01 





18 





04 


6gp8 


4.1 


8.9 


5.5 


4 


3 


6.0 


4.5 


2 


4 


3 


8 





01 


0.01 


0.01 





01 





01 





01 





04 





01 


6r22 


25.9 


44.1 


28.6 


26 


4 


26.8 


27.3 


2 


7 


8 


6 





01 


0.01 


0.01 





01 





01 





01 





21 





02 


7gp5 


5.5 


11.3 


7.0 


5 


9 


6.6 


5.9 


3 


5 


5 


1 





00 


0.00 


0.00 





00 





00 





00 





04 





00 


7rl4 


37.9 


88.6 


55.7 


33 


6 


51.4 


44.3 








15 








00 


0.00 


0.00 





00 





00 





00 





14 





01 


8gp4 


4.2 


11.5 


5.2 


3 


6 


4.2 


3.6 


3 




3 


6 





no 


0.00 


0.00 





00 





00 





00 





07 





00 


8r9 


10.0 


15<s.iJ 


107,8 


51 


1 


()5.() 


05. () 








:5() 








00 


0,00 


0.00 





00 





(K) 





00 





1:-! 





01 



All avg. 


15.2 


30.5 


20.2 


13.4 


16.4 


15.3 


2 


GP avg. 


4.7 


7.5 


4.9 


4.2 


4.8 


4.3 


2 


Rand. avg. 


25.8 


53.4 


35.5 


22.5 


28.0 


26.3 


1 


3-AP avg. 


10.5 


2.3 


2.3 


2.3 


2.3 


2.3 


2 


4-AP avg. 


10.1 


5.8 


4.9 


4.9 


5.7 


4.9 


2 


5-AP avg. 


12.0 


13.0 


9.0 


9.0 


10.1 


9.0 


2 


6-AP avg. 


15.0 


26.5 


17.1 


15.3 


16.4 


15.9 


2 


7-AP avg. 


21.7 


49.9 


31.4 


19.7 


29.0 


25.1 


i 


8-AP avg. 


22.1 


85.2 


56.5 


29.0 


34.9 


34.6 


1 



1 


6.9 


0.01 


0.01 


0.01 


0.01 





01 


0.01 





14 


0.03 


8 


4.0 


0.02 


0.02 


0.02 


0.02 





02 


0.02 





11 


0.03 


4 


9.9 


0.01 


0.01 


0.01 


0.01 





01 


0.01 





16 


0.03 


1 


2.0 


0.03 


0.03 


0.03 


0.04 





04 


0.04 





24 


0.07 


6 


2.5 


0.02 


0.03 


0.03 


0.03 





03 


0.03 





16 


0.06 





4.0 


0.01 


0.01 


0.01 


0.01 





01 


0.01 





11 


0.02 


6 


6.2 


0.01 


0.01 


0.01 


0.01 





01 


0.01 





13 


0.01 


8 


10.0 


0.00 


0.00 


0.00 


0.00 





00 


0.00 





09 


0.01 


6 


16.8 


0.00 


0.00 


0.00 


0.00 





00 


0.00 





10 


0.01 



3cql50 


26.8 


8.1 


8.1 


8.1 


8.1 


8.1 


8.0 


8.0 


0.07 


0.07 


0.07 


0.07 


0.08 


0.08 


1 


18 


0.26 


3gl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.07 


0.07 


0.07 


0.07 


0.08 


0.08 


1 


09 


0.22 


3pl50 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.61 


0.65 


0.66 


0.66 


0.66 


0.66 


1 


92 


0.96 


3srl50 


29.9 


9.8 


9.8 


9.8 


9.8 


9.8 


9.4 


9.1 


0.07 


0.07 


0.07 


0.07 


0.08 


0.09 


1 


49 


0.26 


4cq50 


19.0 


11.6 


11.6 


11.6 


11.6 


11.6 


11.3 


11.6 


0.16 


0.16 


0.16 


0.16 


0.16 


0.16 





44 


0.21 


4g50 


0.0 


0.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.22 


0.22 


0.22 


0.22 


0.22 


0.22 





43 


0.29 


4p50 


0.1 


0.2 


0.1 


0.1 


0.1 


0.1 


0.0 


0.1 


1.04 


1.04 


1.04 


1.04 


1.04 


1.05 


1 


39 


1.12 


4sr50 


20.0 


10.9 


11.3 


11.3 


10.9 


11.3 


10.3 


11.0 


0.19 


0.19 


0.20 


0.20 


0.20 


0.20 





47 


0.25 


5cq30 


14.2 


9.6 


9.5 


9.5 


9.6 


9.5 


9.3 


9.4 


0.64 


0.64 


0.64 


0.64 


0.64 


0.64 


1 


03 


0.68 


5g30 


00 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.94 


0.94 


0.94 


0.94 


0.94 


0.94 


1 


26 


0.97 


5p30 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.72 


2.71 


2.72 


2.72 


2.72 


2.72 


3 


23 


2.76 


5sr30 


11.7 


8.9 


8.5 


8.5 


8.3 


8.5 


111 


8.5 


0.67 


0.67 


0.67 


0.67 


0.67 


0.67 


1 


23 


0.69 


6cql8 


9.8 


8.2 


7.8 


7.5 


7.9 


7.8 


6.3 


7.3 


0.43 


0.43 


0.43 


0.43 


0.43 


0.43 


1 


08 


0.44 


6gl8 


00 


0.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.56 


0.56 


0.56 


0.57 


0.56 


0.57 





90 


0.58 


6pl8 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.10 


1.10 


1.10 


1.10 


1.10 


1.10 


1 


69 


1.12 


6srl8 


9.7 


8.6 


8.2 


8.2 


8.5 


8.2 


IL5 


7.8 


0.42 


0.42 


0.42 


0.42 


0.42 


0.42 


1 


15 


0.44 


7cql2 


7.1 


5.7 


5.0 


5.1 


5.1 


5.0 


4.0 


4.9 


1.04 


1.04 


1.04 


1.04 


1.04 


1.04 


2 


20 


1.05 


7gl2 


0.0 


0.5 


0.1 


0.0 


0.0 


0.0 


0.0 


0.0 


1.22 


1.22 


1.22 


1.22 


1.22 


1.22 


1 


77 


1.23 


7pl2 


0.0 


0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.88 


1.87 


1.87 


1.88 


1.87 


1.88 


2 


90 


1.89 


7srl2 


6.5 


5.7 


5.1 


5.2 


5.6 


5.1 


4.0 


5.0 


0.98 


0.98 


0.98 


0.98 


0.98 


0.98 


2 


15 


0.99 


8cq8 


4.7 


4.1 


3.1 


2.8 


3.7 


2.7 


2.2 


2.6 


0.47 


0.47 


0.47 


0.47 


0.47 


0.47 


1 


97 


0.47 


8g8 


0.0 


0.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.57 


0.57 


0.57 


0.57 


0.57 


0.57 


1 


38 


0.58 


8p8 


0.0 


0.2 


0.0 


0.0 


0.0 


0.0 


00 


0.0 


0.71 


0.71 


0.71 


0.71 


0.71 


0.71 


2 


11 


0.72 


8sr8 


3.2 


3.7 


2.8 


2.6 


2.6 


2.5 


2.1 


2.4 


0.47 


0.47 


0.47 


0.48 


0.47 


0.48 


1 


72 


0.48 



All avg. 


6 


8 


4.1 


3.8 


3.8 


3.8 


3.8 


3A 


3.7 





72 





72 


0.72 


0.72 


0.72 


0.72 


1 


51 


0.78 


Clique avg. 


13 


6 


7.9 


7.5 


7.4 


7.6 


7.5 


6.8 


7.3 





47 





47 


0.47 


0.47 


0.47 


0.47 


1 


32 


0.52 


Geom. avg. 








0.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 





60 





60 


0.60 


0.60 


0.60 


0.60 


1 


14 


0.65 


Product avg. 





1 


0.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1 


34 


1 


35 


1.35 


1.35 


1.35 


1.35 


2 


21 


1.43 


SR avg. 


13 


5 


7.9 


7.6 


7.6 


7.6 


7.6 


§M 


7.3 





47 





47 


0.47 


0.47 


0.47 


0.47 


1 


37 


0.52 


3-AP avg. 


14 


2 


4.5 


4.5 


4.5 


4.5 


4.5 


4.4 


4.3 





20 





22 


0.22 


0.22 


0.22 


0.23 


1 


42 


0.43 


4-AP avg. 


9 


8 


5.7 


5.7 


5.7 


5.6 


5.7 


5.4 


5.7 





40 





40 


0.41 


0.41 


0.40 


0.41 





68 


0.47 


5-AP avg. 


6 


5 


4.8 


4.5 


4.5 


4.5 


4.5 


4.1 


4.5 


1 


24 


1 


24 


1.24 


1.24 


1.24 


1.24 


1 


69 


1.27 


6-AP avg. 


4 


9 


4.4 


4.0 


3.9 


4.1 


4.0 




3.8 





63 





63 


0.63 


0.63 


0.63 


0.63 


1 


21 


0.64 


7-AP avg. 


3 


4 


3.1 


2.6 


2.6 


2.7 


2.5 




2.5 


1 


28 


1 


28 


1.28 


1.28 


1.28 


1.28 


2 


26 


1.29 


8-AP avg. 


2 





2.2 


1.5 


1.4 


1.6 


1.3 


1.1 


1.3 





56 





55 


0.56 


0.56 


0.56 


0.56 


1 


80 


0.56 
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Table A. 21: Chain metaheuristic for MAP started from Trivial, Greedy and ROM. 
seconds given. 1 - 2-opt, 2 — IDV, 3 — 2DV, 4 — sDV, 5 — IDV2, 6 — 2DV2, 7 

sDV:,. 8 .sDV,-. 

Solution error, % 



Greedy 



Inst. 



1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


16.3 


1.8 


1.8 


1.8 


1.8 


1.8 


2.8 


2.5 


5.3 


1.7 


1.7 


1.7 


1.8 


1.8 


2.9 


2.3 


9.8 


1.9 


1.9 


1.9 


1.9 


1.9 


2.6 


2.3 


77.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.1 


0.0 


41.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.0 


1.6 


1.1 


1.1 


1.8 


1.1 


0.8 


1.4 


6.3 


1.9 


0.8 


0.8 


1.8 


0.9 


0.8 


1.4 


2.2 


1.7 


0.9 


0.9 


1.7 


1.0 


0.8 


1.4 


55.0 


4.4 


1.9 


1.9 


4.1 


2.3 


0.4 


0.0 


41.6 


4.6 


1.6 


1.6 


4.5 


1.8 


0.8 


0.0 


57.0 


4.3 


2.0 


2.0 


4.3 


2.0 


0.9 


0.0 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 



3gpl00 
3rl50 

4gp30 

4r80 

5gpl2 

5r40 

6gp8 

6r22 

7gp5 

7rl4 

8gp4 

8r9 



40.8 18.5 8.0 8.0 

2.4 2.4 2.4 2.4 

20.5 30.0 10.9 6.4 

3.9 3.9 3.9 3.9 

2.9 33.6 11.4 2.1 

2.1 5.2 4.7 4.2 

0.0 25.6 4.4 0.0 



16.3 8.0 0.0 

2.4 2.4 2.4 2.4 

15.5 8.2 CKO aO 

3.9 3.9 3.9 3.9 



6.4 3.6 M 
2.1 3.6 5.2 
0.0 0.0 0.0 



0.0 
5.2 
0.0 



34.0 19.3 8.0 8.0 
2.4 2.4 2.4 2.4 

19.1 27.7 11.8 5.5 
3.1 3.5 3.5 3.5 
3.6 33.6 10.7 2.1 
0.5 3.1 3.1 3.1 
0.0 22.2 2.2 0.0 



13.5 8.5 M 0.0 

2.4 2.4 2.4 2.4 
15.5 9.1 CLO 00 

3.5 3.5 3.5 
5.7 2.1 OM 00 

2.6 1.6 3.1 2.6 
0.0 0.0 0.0 0.0 



40.3 19.3 8.0 8.0 

2.4 2.4 2.4 2.4 
15.5 32.7 13.6 8.6 

3.5 3.9 3.9 3.9 
4.3 35.7 7.9 0.7 
1.0 4.7 4.7 3.6 
0.0 26.7 4.4 0.0 



15.8 8.8 0.5 

2.4 2.4 2.4 

15.0 9.5 

3.9 3.9 

2.1 3.6 

2.6 4.2 

0.0 0.0 



0.0 
3.9 
0.0 
4.7 
0.0 



0.0 
2.4 
0.0 
3.9 
0.0 
4.7 
0.0 



19.1 10.7 4.3 2.8 4.6 3.0 1.4 lA 13.2 10.1 4.0 2.5 4.4 2.7 1.2 lA 14.3 11.2 4.3 2.8 4.3 3.2 1.4 1^ 



GP avg. 
Rand. avg. 

3- AP avg 

4- AP avg 

5- AP avg, 

6- AP avg, 

7- AP avg, 

8- AP avg 

3cql50 

3gl50 

3pl50 

3srl50 

4cq50 

4g50 

4p50 

4sr50 

5cq30 

5g30 

5p30 

5sr30 

6cql8 

6gl8 

6pl8 

6srl8 

7cql2 

7gl2 

7pl2 

7srl2 

8cqS 



5.4 2.7 2.6 2.5 2^ 2.4 
32.8 18.7 6.1 3.1 7.0 3.7 



2.8 2.8 
0.1 OO 



3.2 2.4 2.2 2.2 2.3 1^ 2.4 2.3 
23.3 17.9 5.7 2.9 6.5 3.6 0.1 OO 



46.5 09 09 09 0.9 0.9 1.4 1.2 



31.0 3.0 

21.1 10.0 
11.4 16.2 

3.4 18.7 

1.0 15.4 



1.5 1.5 
4.8 4.8 
6.7 4.4 
7.7 3.0 

4.6 2.1 



80.7 
0.0 
0.0 
96.0 
27.7 
0.0 
0.0 
31.9 
11.6 
0.0 
0.0 
15.3 
3.2 
0.0 
0.0 
4.1 
0.5 
0.0 
0.0 
0.6 
0.0 
0.0 
0.0 
0.0 



6.2 
(1.(1 
0.0 
7.0 
5.4 

0.0 _ 
0.0 
6.4 7 
2.7 2 
0.0 0, 



0.0 

4.1 4 

0.3 

0.0 



0.0 

0.7 

0.0 

0.0 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



2 OJ2 

OO 

0.0 

7.1 

8 5.8 

OO 

0.0 

1 7.1 
5 2A 
OO 

0.0 

1 3^ 

2 0.4 
OO 
0.0 
5 0.8 
OO 
OO 
0.0 
0.0 
OA) 
0.0 



0.0 
0.0 



3.0 1.7 

8.9 4.8 

8.9 5.3 

5.2 3.7 

1.0 1.8 

6.7 6.7 

0.0 (1.(1 

0.0 0.0 

7.6 7.6 

5.6 6.1 
0.0 0.0 
0.0 0.0 

7.3 7.4 

2.7 2.5 
0.0 0.0 
0.0 0.0 

5.1 4.2 
0.5 0.3 
0.0 0.0 
OO 0.0 

1.2 1.1 
0.0 0.0 
0.0 0.0 
0.0 0.0 
0.1 OO 
0.0 0.0 
0.0 0.0 
0.0 0.0 
0.0 0.0 



0.6 
0.8 
1.2 
2.0 

2.6 



0.7 
0.8 
1.2 
2.0 

2.6 



17.0 9.8 

0.0 0.0 

0.0 0.0 

18.3 11.8 
12.7 9.5 

0.0 0.0 

0.0 0.0 

14.4 8.8 
8.3 4.4 
0.0 0.0 
0.0 0.0 

10.5 6.6 
5.9 1.4 
0.0 0.0 
0.0 0.0 
7.6 1.9 
3.8 0.3 
0.0 0.0 
0.0 0.0 
4.6 0.4 
2.0 0.0 
0.0 0.0 
0.0 0.0 
2.0 0.0 



23.3 0.9 
23.9 3.3 
17.8 10.4 
10.7 15.1 
3.3 18.5 
0.3 12.7 



38.2 
0.0 
0.0 
41.0 
22.6 
0.0 
0.0 
23.3 
11.8 
0.0 
0.0 
13.5 
3.3 
0.0 
0.0 
4.0 
0.4 
0.0 
0.0 
0.7 
0.0 
0.0 
0.0 
0.0 



6.0 
(1.(1 
0.0 
7.4 
5.4 
0.0 
0.0 



2.3 
0.0 
0.0 

4.2 
0.3 
0.0 
0.0 
1.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



0.9 0.9 

1.2 1.2 

4.8 4.8 

7.1 3.9 

7.1 2.8 
2.7 1.6 

6.0 6.0 

0.0 0.0 

0.0 0.0 

7.4 7.4 

6.7 6.7 

0.0 0.0 

0.0 0.0 

7.2 7.2 
2.7 2.6 
0.0 0.0 
OO 0.0 
4.0 4.0 
0.3 0.4 
0.0 0.0 
OO 0.0 
0.9 07 
OO 0.0 
0.0 0.0 
0.0 0.0 
0.0 0.1 
0.0 0.0 
0.0 0.0 
0.0 OO 
0.0 0.0 



0.9 0.9 1.4 1.1 

3.1 1.3 0.8 07 

7.5 5.0 OS 08 
8.9 6.7 1^ 1^ 

4.6 2.6 1^8 1^ 
1.3 0.8 1.6 1.3 



3.4 2.7 2.6 2.4 2^ 2.5 2.6 2.7 
26.1 19.8 6.0 3.2 6.2 4.0 0.2 OO 



21.7 09 09 09 1.0 1.0 1.3 1.1 



6.1 6.0 

0.0 0.0 

0.0 0.0 

7.9 7.9 

6.1 6.8 

0.0 0.0 

0.0 0.0 

7.6 7.4 

2.9 2.8 

0.0 0.0 

OO 0.0 

4.9 4.2 

0.4 0.5 

0.0 0.0 

OO 0.0 

0.9 0.9 

0.0 0.0 

0.0 0.0 

0.0 0.0 

0.0 0.1 

0.0 0.0 

0.0 0.0 

0.0 0.0 

0.0 0.0 



8.4 6.3 

0.0 0.0 

0.0 0.0 

9.1 7A 
9.8 7.4 
0.0 0.0 
0.0 0.0 

9.2 7.6 

5.6 3.9 
0.0 0.0 
0.0 0.0 
7.4 6.0 
4.4 1.5 
0.0 0.0 
0.0 0.0 

5.7 2.5 
2.7 0.4 
0.0 0.0 
0.0 0.0 

3.4 0.6 

2.5 0.0 
0.0 0.0 
0.0 (1.0 
1.7 0.0 



29.6 3.0 

20.9 10.4 

8.9 17.6 

3.9 19.8 

0.5 15.7 



36.8 
0.0 
0.0 
42.8 
26.4 
0.0 
0.0 
30.0 
11.9 
0.0 
0.0 
14.9 
2.7 
0.0 
0.0 
4.2 
0.4 
0.0 
0.0 
0.4 
0.0 
0.0 
0.0 
0.0 



6.4 
0.0 
0.0 
6.7 
6.1 
0.0 
0.0 
6.5 
2.6 
0.0 
OO 
4.3 
0.4 
0.0 
0.0 

1.1 

0.0 
0.0 
0.0 

0.0 
0.0 
0.0 
0.0 
0.0 



1.4 1.4 

4.8 4.8 

8.0 6.6 

6.9 2.3 

4.6 1.8 

6.4 6.4 

0.0 0.0 

0.0 0.0 

6.7 6.8 
6.2 5J) 
0.0 0.0 
0.0 0.0 

7.1 7.1 

2.8 2.6 
0.0 0.0 
0.0 OO 
4.7 4.5 
0.3 0.4 
0.0 0.0 
0.0 0.0 
0.7 1.0 
0.0 0.1 
0.0 0.0 
0.0 OO 
0.0 0.1 
0.0 0.0 
0.0 0.0 
0.0 0.0 
0.0 0.0 



3.0 1.5 

8.6 5.1 

8.7 6.0 
3.0 3.7 

1.3 2.1 

6.5 6.5 
0.0 0.0 
0.0 0.0 
7.0 7.2 

5.4 5.6 
0.0 0.0 
0.0 0.0 
7.3 7.3 
2.9 3.1 
0.0 0.0 
0.0 0.0 

4.6 4.7 
0.6 02 
0.0 0.0 
0.0 0.0 
1.2 0.7 
0.0 0.0 
0.0 0.0 
0.0 0.0 
0.0 0.1 
0.0 0.0 
0.0 0.0 
0.0 0.0 
0.0 0.0 



0.8 
1.0 
1.2 
2.0 

2.3 



0.7 
0.8 
1.2 
2.0 

2.3 



15.8 11.3 

0.0 0.0 

0.0 0.0 

17.8 11.4 

13.0 8.0 

0.0 0.0 

0.0 0.0 

13.5 10.4 

9.0 4.8 
0.0 0.0 
0.0 0.0 

9.8 5.9 
6.5 1.3 
0.0 0.0 
0.0 0.0 

7.1 2.4 

4.3 0.2 
0.0 0.0 
0.0 OO 
5.1 0.3 

1.9 0.0 
0.0 0.0 
0.0 0.0 

2.4 0.0 



All avg. 

Clique avg. 
Gcom. avg. 
Product avg 
SR avg. 

3- AP avg, 

4- AP avg, 

5- AP avg, 

6- AP avg 

7- AP avg, 

8- AP avg. 



11.3 lA 1.4 1.4 1.6 1.5 4.5 2.3 

20.6 2A 2.4 2.5 2.6 2.6 8.3 4.2 

0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

0.0 0.0 0.0 0.0 0.0 0.0 Oil 0.0 

24.6 3A) 3.1 3.1 3.5 3.4 9.6 4.9 



6.6 1.4 1.4 1.4 1.6 1.5 2.9 1.8 



7.1 1.4 1.4 1.4 1.6 1.5 4.4 2.3 



44.2 
14.9 
6.7 
1.8 
0.3 
0.0 



3.3 
3.0 
1.7 
0.3 
0.0 
0.0 



3.3 3.3 

3.2 3.2 

1.7 1^ 

0.2 0.3 

0.0 0.0 

0.0 0.0 



3.6 3.6 

3.2 3.4 

1.9 1.7 

0.4 0.3 

0.0 0.0 

0.0 0.0 



6.8 
4.7 
3.4 
2.1 
1.0 



5.4 
4.6 
2.7 

0.8 
0.2 
0.0 



12.7 
0.0 
0.0 

13.7 

19.8 
11.4 
6.3 

1.8 
0.3 
0.0 



2.3 2.4 2.5 2.6 2.5 5.6 3.2 

0.0 Oil OO 0.0 0.0 0.0 0.0 

0.0 0.0 0.0 0.0 0.0 0^ 0.0 

3.2 3.2 3.2 3.5 3.4 6.1 4.0 



3.4 
3.0 
1.6 
0.3 
0.0 
0.0 



3.4 3.4 

3.2 3.2 

1.7 1.6 

0.3 03 

0.0 0.0 

OO 0.0 



3.5 3.5 4.4 3.4 

3.4 3.3 4.8 3.8 

2.0 1.8 3.2 2.5 

0.3 0.3 2.5 1.0 

0.0 0.0 1.5 0.2 

OO 0.0 1.1 0.0 



13.0 
0.0 
0.0 

15.4 

19.9 
14.1 
6.7 

1.7 
0.2 
0.0 



2.4 2.4 2A 2.6 2.6 8.4 4.3 

O.U 0.0 (I.U 0.0 (1.(1 0.0 0.0 

0.0 0.0 

3.4 3.3 



0.0 
3.1 



0.0 0.0 
3.2 3.2 



0.0 
9.3 



3.3 
2.9 
1.8 

0.4 
0.0 
OO 



3.3 3.3 

3.1 3.0 

1.9 1.8 

0.3 0.4 

0.0 0.0 

0.0 OO 



3.4 3.4 

3.2 3.2 

1.9 1.9 

0.5 02 

0.0 0.0 

0.0 0.0 



0.0 
5.0 



8.4 
6.6 
4.7 

3.4 
2.4 
1.1 



5.7 
4.6 
2.7 
0.9 
0.1 
0.0 
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Table A.22: Chain metaheuristic for MAP started from Trivial, Greedy and ROM. 10 
seconds given. 1 - 2-opt, 2 — IDV, 3 — 2DV, 4 — sDV, 5 — IDV2, 6 — 2DV2, 7 — 

sDV:,. 8 .sDV,-. 



Solution error, % 



Trivial Greedy ROM 



Inst. 


1 


2 


3 


4 


5 


6 


7 


8 


1 


2 




3 


4 


5 


6 


7 


8 


1 


2 


3 


4 


5 


6 


7 


8 


SgplOO 


16.1 


1.6 


1.6 


1.6 


1.7 


1.7 


2.3 


2.2 


5.3 


1.6 


1 


6 


1.6 


1.6 


1.6 


2.5 


2.1 


9.8 


1.6 


1.6 


1.6 


1.8 


1.7 


2.2 


2.1 


3rl50 


76.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


41.4 


0.0 








0.0 


0.0 


0.0 


0.0 


0.0 


33.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4gp30 


6.6 


1.4 


0.8 


0.8 


1.3 


1.0 


0.7 


1.3 


6.2 


1.7 





8 


0.8 


1.5 


0.8 


0.7 


1.1 


2.2 


1.4 


0.8 


0.8 


1.4 


0.8 


0.7 


1.2 


4r80 


62.1 


3.9 


1.1 


1.0 


3.6 


1.1 


0.1 


0.0 


41.4 


3.9 


1 





1.0 


4.3 


1.1 


0.4 


0.0 


55.0 


4.0 


1.1 


1.1 


3.4 


1.3 


0.4 


0.0 


5gpl2 


1.6 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1 


5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


1.5 


6r40 


36.6 


16.3 


6.6 


S.8 


13.0 


6.8 


0.0 


0.0 


32.3 


18.8 


7 





7.0 


13.0 


7.0 


0.0 


0.0 


36.8 


16.6 


6.8 


6.8 


13.8 


7.3 


0.0 


0.0 


6gp8 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2 


4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


2.4 


6r22 


16.8 


27.7 


9.1 


5.0 


12.3 


7.7 


0.0 


0.0 


15.5 


26.8 


11 


4 


4.5 


13.2 


8.2 


0.0 


0.0 


14.1 


30.0 


10.5 


5.9 


12.3 


8.6 


0.0 


0.0 


7gp5 


3.5 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.9 


3.1 


3.5 


3 


5 


3.5 


3.5 


3.1 


3.5 


3.5 


2.7 


3.9 


3.9 


3.9 


3.9 


3.5 


3.9 


3.9 


7rl4 


1.4 


29.3 


7.1 


1.4 


2.9 


2.9 


0.0 


0.0 


0.7 


31.4 


6 


4 


0.7 


4.3 


0.0 


0.0 


0.0 


2.9 


29.3 


5.7 


0.7 


0.0 


2.1 


0.0 


0.0 


8gp4 


1.6 


5.2 


4.7 


3.6 


1.0 


2.1 


5.2 


3.6 


0.5 


3.1 


2 


1 


2.6 


1.6 


1.6 


2.6 


2.6 


1.0 


4.7 


4.7 


3.6 


1.0 


2.1 


4.2 


4.2 


8r9 


0.0 


23.3 


1.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


15.6 


1 


1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


22.2 


4.4 


0.0 


0.0 


0.0 


0.0 


0.0 


All avg. 


17.7 


9.7 


3.3 


2.3 


3.6 


2.6 


1.3 


1.2 


12.5 


9.2 


3 


2 


2.1 


3.9 


2.3 


1.1 


1.1 


13.6 


9.8 


3.6 


2.4 


3.5 


2.6 


1.3 


1.3 


GP avg. 


6.1 


2.7 


2.6 


2.3 


2.0 


2.1 


2.7 


2.5 


3.2 


2.3 


2 





2.1 


2.0 


1.8 


2.2 


2.2 


3.3 


2.6 


2.5 


2.3 


2.0 


2.0 


2.5 


2.6 


Rand. avg. 


30.4 


16.7 


4.2 


2.2 


5.3 


3.1 


0.0 


0.0 


21.9 


16.1 


4 


5 


2.2 


5.8 


2.7 


0.1 


0.0 


23.7 


17.0 


4.7 


2.4 


4.9 


3.2 


0.1 


0.0 


3-AP avg. 


45.2 


0.8 


0.8 


0.8 


0.9 


0.9 


1.1 


1.1 


23.3 


0.8 





8 


0.8 


0.8 


0.8 


1.3 


1.0 


21.7 


0.8 


0.8 


0.8 


0.9 


0.9 


1.1 


1.1 


4-AP avg. 


29.3 


2.7 


1.0 


0.9 


2.5 


1.0 


0.4 


0.7 


23.8 


2.8 





9 


0.9 


2.9 


0.9 


0.5 


0.6 


28.6 


2.7 


1.0 


1.0 


2.4 


1.0 


0.5 


0.6 


5-AP avg. 


19.0 


8.9 


4.0 


3.6 


7.3 


4.1 


0.8 


0.8 


16.9 


10.1 


4 


3 


4.3 


7.3 


4.3 


0.8 


0.8 


19.1 


9.0 


4.1 


4.1 


7.6 


4.4 


0.8 


0.8 


6-AP avg. 


9.6 


16.1 


6.7 


3.7 


7.3 


5.1 


1.2 


1.2 


8.9 


14.6 


6 


9 


3.6 


7.8 


6.3 


1.2 


1.2 


8.2 


16.2 


6.4 


4.2 


7.3 


6.6 


1.2 


1.2 


7-AP avg. 


2.5 


16.6 


5.5 


2.7 


3.4 


3.4 


2.0 


2.0 


1.9 


17.5 


5 





2.1 


3.9 


1.6 


1.8 


1.8 


2.8 


16.6 


4.8 


2.3 


2.0 


2.8 


2.0 


2.0 


8-AP avg. 


0.8 


14.3 


2.9 


1.8 


0.5 


1.0 


2.6 


1.8 


0.3 


9.3 


1 


6 


1.3 


0.8 


0.8 


1.3 


1.3 


0.5 


13.5 


4.6 


1.8 


0.5 


1.0 


2.1 


2.1 



3cql50 79.8 5^ 5^ 5^ 5.9 5.9 13.3 8.3 38.2 5^ 5^ 5^ 5.7 5.8 7.9 6.1 36.8 6.1 5^ 5^ 6.3 6.2 12.7 8.2 

3gl50 ()X)(U)M)ax2M!5L£MI(LO MIOilfLIllliOO^lLOCLOOJJ 0.0 0.0 0.0 0.0 0.0 ().() 0.0 0.0 

3pl50 0.0 0.0 0.0 0.0 0.0 0.0 OA) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 (XO 0.0 0.0 0.0 0.0 0.0 0.0 0.0 00 0.0 

3srl50 93.9 6^ 6^ 6^ 6.7 6.7 15.8 10.2 41.0 6^ 6^ 6^ 6.6 6.6 8.3 7.2 42.8 6.6 6^ 6^ 6.7 6.7 14.5 9.1 

4cq50 26.2 6.0 6.0 4^ 5.2 6.3 9.9 6.5 22.4 4^ 5.3 6.2 5.4 6.6 8.9 7.0 26.6 4S 4.8 4.8 6.2 4.9 11.3 7.1 

4g50 qj) qj) qj) qj) qj) qj) OM qj) qj) qA) qj) qA) qj) qj) qj) qj) o.o o.o o.o o.o o.o o.o o.o o.o 

4p50 0.0 0.0 0.0 0.0 0.0 0.0 fU) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OJ) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 (U) 0.0 

4sr50 30.8 5^ 6.6 6.6 6.5 6.9 11.2 8.2 23.3 6A 6.5 6.5 6.7 6.6 8.9 6.7 29.3 6.2 6A 6J. 6.9 6.7 11.3 9.2 

5cq30 10.9 2.2 1^ 2.0 2.0 2.1 6.9 4.2 11.0 1^ 2.2 2.2 2.3 2.5 5.1 3.4 11.4 2.4 2^ 2.3 2.4 2.4 7.3 3.7 

6g30 gjjg^g^MtLiOMMOiO m(LlOM(LlOM(LlOMOiO o.o o.o o.o o.o o.o o.o o.o o.o 

5p30 0.0 0.0 0.0 0.0 0.0 0.0 OX) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 M 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OA) 0.0 

5sr30 13.8 3.7 3.5 3^ 3.9 3.5 8.9 5.0 12.2 3.9 3^ 3^ 4.0 3.7 6.3 4.9 14.0 4.0 4.0 4.0 3^ 4.2 8.6 4.8 

6cql8 2.5 0.2 ai 0.3 0.4 0.2 4.1 0.8 2.7 0.3 0.2 OA) 0.2 0.4 3.5 0.8 2.3 0.2 Ol 0.2 0.2 0.2 4.8 1.0 

6gl8 0J30i)0J)0J)0^0J)0X)0i) OA) OA) OA} OA) OA) OA) OA) OA) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

6pl8 0.0 0.0 0.0 00 0.0 00 OA) 0.0 0.0 0.0 0.0 0.0 0.0 OA) OA) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OA) 0.0 

6srl8 3.4 0.4 0.4 0^ 0.7 0.8 5.1 1.0 3.4 0.7 0.7 03 0.6 0.6 4.8 2.0 3.8 05 0.6 0.5 0.8 0.6 5.5 1.8 

7cql2 0.2 OA) 0.0 0.0 0.0 OA) 2.7 0.1 0.2 OO 0.0 0.0 OA) 0.0 2.1 0.1 0.2 OO 01)00 0.0 OO 3.4 0.1 

7gl2 0J)0i)0^0i)0^0i)0i)O0 0i)0i)0i)0i)0i)0^0i)O0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

7pl2 0.0 0.0 0.0 OO OA) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OO 0.0 OO 0.0 0.0 0.0 0.0 0.0 OO 0.0 OO 0.0 

7srl2 0.2 OO OO 0.0 OO 3.5 0.1 0.5 OO OA) 0.1 0.0 OA) 2.4 0.2 0.3 CKO OX) 0.1 OX) OO 4.1 0.2 

8cq8 OJD Cy) CU2 OX) Cy) OX) 1.4 0.0 Ml Oi) (LX) OO OX) OO 1.4 0.0 OX) OO OX) OO OA) OA) 1.4 0.0 

8g8 M0J)M0^0X)OX)0X)0J) MO;OO^MI(LX)lWOX)0^ 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

8p8 0.0 0.0 0.0 OA) OA) OA) OA) 0.0 OA) 0.0 0.0 OO OO OX) 0.0 OO 0.0 0.0 0.0 0.0 0.0 0.0 OO 0.0 

8sr8 (W)W)(W)OX)MtL0 1-4OX) MMM0^£LX)0;0 1-4O0 0.0 0.0 0.0 0.0 0.0 0.0 2.1 0.0 



All avg. 10.9 1.2 1.2 1^ 1.3 1.3 3.6 1.9 6.6 1.3 1.3 1^ 1.3 1.3 2.6 1.6 6.9 1.3 1^ 1.3 1.4 1.3 3.6 1.9 

Clique avg. 19.9 2.1 2A 2.1 2.2 2.3 6.4 3.3 12.4 2^1 2.2 2.2 2.3 2.4 4.8 2.9 12.7 2.2 2^ 2.2 2.4 2.3 6.8 3.3 

Gcom. avg. MM()X)M0X)(M0X)O0 MSJlO^MIO^MOiOOO 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 

Product avg. 0.0 0.0 0.0 0.0 0.0 0.0 OO 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OX) 0.0 0.0 0.0 0.0 0.0 0.0 0.0 OX) 0.0 

SR avg. 23.7 2^ 2.8 2.7 3.0 3.0 7.7 4.1 13.4 2.9 2.8 2^ 3.0 2.9 5.3 3.5 15.0 2.9 2.9 2^ 3.0 3.0 7.7 4.2 

3- AP avg. 43.4 2^ 2^ 2^ 3.1 3.1 7.3 4.6 19.8 3A) 3M 3A) 3.1 3.1 4.0 3.3 19.9 3.2 3J. 3.1 3.2 3.2 6.8 4.3 

4- AP avg. 14.2 2^ 2.9 2.9 2.9 3.1 5.3 3.7 11.4 2^ 2.9 2.9 3.0 3.0 4.4 3.4 13.7 iTT 2.7 2.7 3.0 2.9 5.7 4.1 

5- AP avg. 6.2 1.5 1.3 1^ 1.5 1.4 3.9 2.3 5.8 1.5 1.4 lA 1.6 1.6 2.8 2.1 6.4 1.6 1.6 1^3 1.6 1.7 4.0 2.1 

6- AP avg. 1.5 0.1 Ol 0.2 0.3 0.3 2.3 0.5 1.5 0.2 0.2 Ol 0.2 0.3 2.1 0.7 1.5 0.2 0.2 02 0.3 0.2 2.6 0.7 

7- AP avg. 0.1 0.0 0.0 0.0 0.0 OX) 1.5 0.1 0.2 0.0 OO 0.0 0.0 0.0 1.1 0.1 0.1 0.0 0.0 0.0 0.0 OO 1.9 0.1 

8- AP avg. 0.0 0.0 0.0 OO OX) OX) 0.7 0.0 OA) 0.0 0.0 OO OO OO 0.7 0.0 0.0 0.0 OO 0.0 OO OO 0.9 0.0 
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Table A.23: Multichain metaheuristic for MAP started from Trivial, Greedy and ROM. 5 
seconds given. 1 - 2-opt, 2 — IDV, 3 — 2DV, 4 — sDV, 5 — IDV2, 6 — 2DV2, 7 — 

sDV:,. 8 .sDV,-. 



Solution error, 



Inst. 



6 



Greedy 
2 3 4 5 



6 



SgplOO 
3rl50 

4gp30 

4r80 

5gpl2 

6r40 

6gp8 

6r22 

7gp5 

7rl4 

8gp4 

8r9 



11.8 

68.1 
3.0 

45.3 
1.5 

26.0 
2.4 
8.6 
3.9 
0.0 
2.1 
0.0 



1.1 1.2 1.3 1.3 156.9 2.0 

oi) 00 oi) 00 oi) 05 Oi) 

0.9 07 0^ 0.8 C^7 07 1.1 

3.4 1.5 1.4 2.3 1.5 0.4 CUJ 

1_^ 1_^ 1^ 1^ 1^ 

15.3 6.3 5.5 10.8 6.3 516.8 OO 
2^ 2^ 2^ 2.4 2.4 

20.0 6.8 4.5 7.7 5.9 

3.9 3J5 3.9 
18.6 7.1 0.7 

5.2 4.7 4.2 

14.4 2.2 0.0 



3.9 3.9 
0.0 2.1 
2.1 4.2 
0.0 0.0 



2.4 
0.0 
3.9 
0.0 
3.6 
0.0 



2.4 
0.0 
3.9 
0.0 
4.2 
0.0 



5.3 
41.4 
3.1 
38.9 
1.5 
26.8 
2.4 
9.1 
3.5 
0.0 
1.6 
0.0 



1.2 
0.0 
0.8 
3.3 
1.5 



14.5 
2.4 

20.9 
3.5 

23.6 
3.6 

17.8 



1.4 1.3 
0.0 0.0 

1.0 07 

3.1 0.9 

1.5 1.5 
10.0 6.0 

2.4 2.4 
7.3 4.5 

3.5 3.5 
0.7 2.9 
2.1 1^ 
0.0 0.0 



6.6 2.2 

0.0 0.0 

0.7 1.0 

0.8 OO 

1.5 1.5 



0.0 0.0 

2.4 2.4 

0.0 0.0 

3.5 3.5 



0.0 0.0 
3.6 3.1 
0.0 0.0 



9.7 1.2 1.2 1.2 

33.6 0.0 0.0 0.0 

2.1 0.7 0.7 0.7 

44.6 2.4 1.0 1.0 

1.5 1.5 1.5 1.5 

28.3 15.3 6.8 6.8 

2.4 2.4 2.4 2.4 

6.4 20.5 8.6 5.5 

3.9 3.9 3.9 3.9 

0.0 21.4 7.1 2.1 

0.5 4.7 5.2 4.2 

0.0 14.4 2.2 0.0 



1.3 1.3 9.8 2.0 

OJ) OO 0.0 0.0 

0.7 0.7 0.8 1.0 

2.6 1.1 45.3 CUJ 

1.5 1.5 1.6 1.5 



11.0 7.0 152.6 OO 
2^ 2^ 2.4 2.4 

9.5 5.0 30.0 0.0 



3.9 3Jj 
0.0 2.1 
2.6 4.7 
0.0 0.0 



3.9 
0.0 
4.7 
0.0 



3.9 
0.0 
3.6 
0.0 



All avg. 


14.4 


7.2 


3 


1 


2.2 


2 


7 


2.5 


57.2 


1 


_3 


11.1 


7.8 


3.0 


1.9 


2.7 


2 





1 


6 




Jl 


11.1 


7.4 


3.4 


2 


4 


3.0 


2 


6 


20 


9 


1.2 


GP avg. 


4.1 


2.5 


2 


3 


2.3 


2 





2.3 


28.2 


2 


5 


2.9 


2.2 


2.0 


2.0 


2.0 


1 


8 


2 


9 


2 


3 


3.4 


2.4 


2.5 


2 


3 


2.1 


2 


4 


3 


8 


2.4 


Rand. avg. 


24.7 


11.9 


3 


8 


2.0 


3 


6 


2.6 


86.2 








19.4 


13.3 


4.1 


1.8 


3.5 


2 


2 





1 








18.8 


12.3 


4.3 


2 


6 


3.9 


2 


6 


38 





0.0 


3-AP avg. 


40.0 


0.6 





6 


0.6 





6 


0.6 


78.5 


1 





23.3 


0.6 


0.6 


0.6 


0.7 





7 


2 


8 


1 


1 


21.7 


0.6 


0.6 





6 


0.7 





7 


4 


9 


1.0 


4-AP avg. 


24.1 


2.1 


1 


1 


1.0 


1 


5 


1.1 


0.5 





6 


21.0 


2.0 


0.8 


0.8 


2.0 





8 





7 





5 


23.3 


1.5 


0.8 





8 


1.7 





9 


23 





0.5 


5-AP avg. 


13.8 


8.4 


3 


4 


3.5 


6 


1 


3.9 


259.1 





8 


14.1 


8.0 


3.4 


3.6 


5.8 


3 


3 





8 





8 


14.9 


8.4 


4.1 


4 


1 


6.3 


4 


3 


77 





0.8 


6-AP avg. 


6.6 


11.2 


4 


6 


3.5 


6 


1 


4.2 


1.2 


1 


2 


5.7 


11.7 


5.1 


2.6 


4.8 


3 


6 


1 


2 


1 


2 


4.4 


11.4 


5.5 


3 


9 


6.0 


3 


7 


16 


2 


1.2 


7-AP avg. 


2.0 


11.2 


5 


3 


2.3 


2 





3.0 


2.0 


2 





1.8 


13.5 


6.0 


2.6 


2.1 


3 


2 


1 


8 


1 


8 


2.0 


12.7 


5.5 


3 





2.0 


2 


8 


2 





2.0 


8-AP avg. 


1.0 


9.8 


3 


5 


2.1 


1 





2.1 


1.8 


2 


1 


0.8 


10.7 


2.4 


1.3 


1.0 





8 


1 


8 


1 


6 


0.3 


9.6 


3.7 


2 


1 


1.3 


2 


3 


2 


3 


1.8 



3cql50 


75.2 


3.9 


3.8 


3.7 


4.4 


4.3 


1219.1 


491.9 


38.2 


2.5 


2.5 


2.5 


3.1 


3.0 


41.1 


20.9 


36.8 


3.9 


3.8 


3.7 


4.8 


4.8 


36.8 


24.2 


3gl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


865.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


19.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.9 


0.0 


3pl50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


76.3 


76.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


215.3 


215.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.2 


7.2 


3srl50 


85.8 


4.5 


4.3 


4.5 


5.6 


5.5 


1249.7 


630.5 


41.0 


3.2 


3.2 


3.2 


3.4 


3.3 


41.9 


7.4 


42.8 


4.0 


3.9 


4.0 


4.9 


4.9 


42.8 


32.7 


4cq60 


12.7 


2.8 


4.4 


4.2 


3.6 


4.8 


283.6 


9.7 


10.6 


1.9 


2.9 


2.9 


2.5 


3.6 


13.9 


6.6 


13.5 


3.8 


3.2 


3.2 


3.8 


3.6 


28.4 


9.6 


4g50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


4p50 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


102.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


484.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8.3 


0.0 


4sr50 


16.4 


3.0 


3.4 


3.5 


3.1 


3.9 


155.4 


10.7 


13.7 


2.1 


3.0 


3.1 


2.2 


3.4 


19.5 


7.1 


15.9 


3.8 


4.2 


4.0 


3.9 


4.8 


29.2 


10.5 


5cq30 


3.4 


2.1 


1.4 


1.4 


3.0 


1.6 


154.5 


4.4 


3.6 


2.0 


2.2 


2.2 


2.3 


2.2 


20.2 


3.2 


4.1 


2.2 


2.2 


2.2 


2.7 


2.3 


21.2 


4.6 


6g30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


5p30 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


137.2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1016.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.6 


0.0 


5sr30 


6.0 


2.4 


3.4 


3.4 


2.7 


3.6 


195.6 


5.3 


4.6 


2.3 


2.3 


2.2 


2.2 


2.4 


15.8 


4.2 


4.7 


3.4 


3.1 


3.2 


3.9 


3.4 


27.6 


6.4 


6cql8 


2.8 


2.1 


2.0 


1.4 


1.8 


1.8 


141.9 


3.0 


1.9 


1.6 


1.5 


1.5 


1.7 


1.2 


15.4 


2.3 


2.7 


2.2 


1.9 


1.8 


1.4 


2.1 


18.1 


2.3 


6gl8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


260.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


26.3 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.6 


0.0 


6pl8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


162.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2117.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


7.8 


0.0 


6srl8 


3.8 


1.9 


2.4 


2.2 


2.3 


2.3 


120.7 


3.5 


3.0 


2.0 


2.1 


2.0 


2.1 


2.1 


13.2 


2.6 


3.9 


2.3 


1.8 


2.1 


2.7 


1.7 


19.1 


3.0 


7cql2 


0.9 


1.0 


1.0 


1.0 


0.5 


0.9 


91.5 


1.2 


0.7 


0.6 


0.7 


0.6 


0.8 


0.4 


13.8 


0.6 


1.1 


0.8 


0.2 


0.9 


0.8 


0.3 


14.8 


1.1 


7gl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


156.4 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


18.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


2.4 


0.0 


7pl2 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


346.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3161.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


9.2 


0.0 


7srl2 


1.1 


1.4 


0.9 


1.2 


1.0 


1.1 


77.7 


0.9 


1.4 


1.0 


1.1 


1.1 


0.6 


0.7 


9.4 


1.2 


1.8 


1.1 


0.7 


0.8 


1.0 


1.0 


14.9 


1.2 


8cqS 


0.1 


0.3 


0.2 


0.2 


0.1 


0.4 


62.3 


0.2 


0.2 


0.2 


0.1 


0.2 


0.1 


0.1 


10.4 


0.3 


0.2 


0.3 


0.2 


0.3 


0.2 


0.2 


9.9 


0.3 


8g8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


104.5 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


14.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.4 


0.0 


8p8 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


176.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


3604.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


9.0 


0.0 


8sr8 


0.6 


0.2 


0.3 


0.4 


0.1 


0.2 


51.9 


0.3 


0.2 


0.6 


0.4 


0.4 


0.2 


0.3 


6.6 


0.6 


0.3 


0.5 


0.3 


0.6 


0.2 


0.3 


9.8 


0.4 


All avg. 


8.7 


1.1 


1.1 


1.1 


1.2 


1.3 


258.0 


61.6 


5.0 


0.8 


0.9 


0.9 


0.9 


0.9 


454.3 


11.3 


5.3 


1.2 


1.1 


1.1 


1.3 


1.2 


13.8 


4.3 


Clique avg. 


15.9 


2.0 


2.1 


2.0 


2.2 


2.3 


325.5 


85.1 


9.2 


1.5 


1.7 


1.7 


1.8 


1.7 


19.1 


5.6 


9.7 


2.2 


1.9 


2.0 


2.3 


2.2 


21.5 


7.0 


Gcom. avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


231.1 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


13.6 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1.5 


0.0 


Product avg. 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


167.0 


12.7 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


1766.7 


35.9 


0.0 


0.0 


0.0 


0.0 


0.0 


0.0 


8.2 


1.2 


SR avg. 


18.9 


2.3 


2.5 


2.5 


2.5 


2.8 


308.5 


108.5 


10.7 


1.8 


2.0 


2.0 


1.8 


2.0 


17.7 


3.9 


11.6 


2.5 


2.3 


2.4 


2.8 


2.7 


23.9 


9.0 


3-AP avg. 


40.2 


2.1 


2.0 


2.1 


2.6 


2.4 


852.6 


299.7 


19.8 


1.4 


1.4 


1.4 


1.6 


1.6 


79.4 


60.9 


19.9 


2.0 


1.9 


1.9 


2.4 


2.4 


22.4 


16.0 


4-AP avg. 


7.3 


1.5 


2.0 


1.9 


1.7 


2.2 


135.4 


5.1 


6.1 


1.0 


1.5 


1.6 


1.2 


1.7 


129.4 


3.4 


7.4 


1.9 


1.8 


1.8 


1.9 


2.1 


16.6 


5.0 


5-AP avg. 


2.3 


1.2 


1.2 


1.2 


1.4 


1.3 


121.8 


2.4 


2.1 


1.1 


1.1 


1.1 


1.1 


1.2 


263.8 


1.8 


2.2 


1.4 


1.3 


1.4 


1.6 


1.4 


14.1 


2.8 


6-AP avg. 


1.6 


1.0 


1.1 


0.9 


1.0 


1.0 


171.4 


1.6 


1.2 


0.9 


0.9 


0.9 


1.0 


0.8 


543.1 


1.2 


1.7 


1.1 


0.9 


1.0 


1.0 


1.0 


11.9 


1.3 


7-AP avg. 


0.5 


0.6 


0.5 


0.6 


0.4 


0.5 


167.9 


0.5 


0.5 


0.4 


0.4 


0.4 


0.4 


0.3 


800.9 


0.5 


0.7 


0.5 


0.2 


0.4 


0.5 


0.3 


10.3 


0.6 


8-AP avg. 


0.2 


0.1 


0.1 


0.1 


0.0 


0.2 


98.9 


0.1 


0.1 


0.2 


0.1 


0.2 


0.1 


0.1 


909.1 


0.2 


0.1 


0.2 


0.1 


0.2 


0.1 


0.1 


7.5 


0.2 
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Table A. 24: Multichain metaheuristic for MAP started from Trivial, Greedy and ROM. 
10 seconds given. 1 — 2-opt, 2 — IDV, 3 — 2DV, 4 — sDV, 5 — IDV2, 6 — 2DV2, 7 — 

sDV:,. 8 .sDV,-. 

Solution error, % 



Inst. 



6 



Greedy 
2 3 4 5 



6 



SgplOO 
3rl50 

4gp30 

4r80 

5gpl2 

6r40 

6gp8 

6r22 

7gp5 

7rl4 

8gp4 

8r9 



11.2 

66.3 
2.9 

43.8 
1.6 

26.8 
2.4 
6.4 
3.9 
0.0 
0.0 
0.0 



1.0 
0.0 
0.7 
2.5 
1.5 

12.5 
2.4 

18.2 
3.9 

16.4 
5.2 

13.3 



1.0 1.0 

0.0 0.0 

0.7 0.7 

0.9 0.9 

1.5 1.5 

4.0 4.0 

2.4 2.4 
5.9 2.7 

3.5 3.9 
4.3 OM 
4.7 3.6 
0.0 0.0 



1.1 1.1 

0.0 0.0 

0.7 0.7 

2.1 1.0 

1.5 1.5 
9.0 4.0 
2.4 2.4 
6.4 5.0 
3.9 3.9 
0.0 0.0 

1.6 2.6 
0.0 0.0 



2.5 1.7 

0.0 0.0 

0.7 1.0 

0.2 ao 

1.5 1.5 



0.0 0.0 
2.4 2.4 

0.0 0.0 



3.1 
0.0 
3.6 
0.0 



3.9 
0.0 
4.2 
0.0 



5.3 U) U) 

41.4 ao OJ) 

2.6 0.8 (X7 

38.1 2.3 0.6 

1.5 1.5 1.5 

23.5 13.3 4.8 

2.4 2.4 2.4 

6.4 18.2 6.4 

3.5 3.5 3.5 
0.0 19.3 5.0 
1.0 3.1 2.6 
0.0 13.3 0.0 



1.0 1.1 1.1 
0.0 0.0 0.0 

0.7 0.7 0.7 

0.6 2.3 0.6 

1.5 1.5 1.5 

4.5 9.0 4.8 

2.4 2.4 2.4 
2.3 5.0 2.7 

3.5 3.5 3.5 
0.0 0.0 1.4 

2.1 IJ) 1.6 
0.0 0.0 0.0 



8 1.8 

OM 

7 0.9 

5 OA) 

5 1^ 

OX) 

4 2A 
M 

5 3J) 
OA) 

6 2.1 
0.0 



9.7 

33.6 
2.1 

42.4 
1.5 

25.8 
2.4 
5.9 
3.9 
0.0 
0.0 
0.0 



1.0 1.0 

0.0 0.0 0.0 

0.7 0.7 0.7 

2.0 0.8 0.8 

1.5 1.5 1.5 

14.3 5.5 6.6 

2.4 2.4 2.4 

17.3 6.8 3.6 

3.9 3J) 3.9 

17.9 5.0 ao 

4.7 5.2 3.6 

10.0 1.1 0.0 



1.2 1.1 2.3 1.7 

0.0 0.0 0.0 0.0 

07 07 07 0.8 

2.0 0.8 0.5 OA) 

1.5 1.5 1.5 1.5 



9.8 6.6 

2.4 2.4 

5.5 4.5 

3.9 3J) 
0.0 0.0 

1.6 3.6 
0.0 0.0 



0.0 

2.4 
0.0 
3.9 
0.0 
4.2 
0.0 



0.0 

2.4 
0.0 
3.9 
0.0 
2.6 
0.0 



13.6 6.5 2.4 1.7 2.4 1.9 



10.5 6.6 2.4 1.6 2.2 1.7 



10.6 6.3 2.8 1.9 2.4 2.0 1.3 lA 



GP avg. 
Rand. avg. 

3- AP avg 

4- AP avg 

5- AP avg, 

6- AP avg, 

7- AP avg, 

8- AP avg 

3cql50 

3gl50 

3pl50 

3srl50 

4cq50 

4g50 

4p50 

4sr50 

5cq30 

6g30 

5p30 

5sr30 

6cql8 

6gl8 

6pl8 

6srl8 

7cql2 

7gl2 

7pl2 

7srl2 

8cqS 



3.7 2.4 2.3 2.2 
23.6 10.5 2.6 1.3 



1.9 2.0 
2.9 1.7 



2.3 2.4 
0.0 OO 



38.2 05 05 0^ 0.6 0.6 

23.3 1.6 0.8 0.8 1.4 0.8 
13.6 7.0 2.8 2.8 5.3 2.8 

4.4 10.3 4.2 2.6 4.4 3.7 

2.0 10.2 3.9 2.0 2.0 2.0 

0.0 9.3 2.3 1.8 0.8 1.3 



71.4 
0.0 
0.0 

82.1 

11.1 
0.0 
0.0 

14.6 
2.2 
0.0 
0.0 
4.6 
2.8 
0.0 
0.0 
3.5 
0.9 
0.0 
0.0 
1.0 
0.1 
0.0 
0.0 
0.6 



1.9 1/7 

0.0 0.0 

0.0 0.0 

3.0 3.1 
2.6 3.4 
0.0 0.0 
0.0 0.0 
2.(1 2.7 

2.1 1.3 
0.0 0.0 
0.0 0.0 

2.2 3.3 
2.1 2.0 
0.0 0.0 
0.0 0.0 
1.8 2.4 
1.0 1.0 
0.0 0.0 
0.0 0.0 
1.4 0.9 
0.2 0.2 
0.0 0.0 
0.0 0.0 
0.2 0.3 



1.8 3.0 2.9 
0.0 (1.(1 0.0 
0.0 0.0 0.0 

2.9 4.0 3.9 
3.3 3.2 3.8 
0.0 0.0 0.0 
0.0 OO 0.0 
2.6 2.6 3.2 
1.3 2.4 1.3 
0.0 0.0 0.0 
0.0 OO 0.0 

3.3 2.6 3.4 

1.4 1.8 1.7 
0.0 0.0 0.0 
0.0 0.0 0.0 
2.0 2.3 2.3 

1.0 05 0.9 
0.0 0.0 0.0 
OO OO 0.0 

1.1 1.0 1.1 
0.2 OO 0.4 
0.0 0.0 0.0 
0.0 OO 0.0 
0.4 0.1 0.2 



1.3 
0.5 
0.8 
1.2 
1.6 
1.8 

1219.1 
865.3 
76.3 
1249.7 
11.3 
0.0 
0.0 
12.9 
8.0 
0.0 



0.0 

9.6 
5.6 
0.0 
0.0 
6.5 
38.6 
0.0 
346.1 
62.4 
62.3 
104.5 
176.7 
51.9 



0.9 
0.5 
0.8 
1.2 
2.0 
2.1 

8.8 
(1.(1 
0.0 
10.5 
7.8 
0.0 
0.0 
8.1 
3.5 
0.0 
0.0 
4.3 
2.4 
0.0 
0.0 
3.2 
1.2 
0.0 
0.0 
0.9 
0.2 
0.0 
0.0 
0.2 



2.7 2.1 2.0 1.9 1/7 1.8 

18.2 11.1 2.8 1.2 2.7 1.6 

23.3 05 0^ 05 0.6 0.5 

20.4 1.5 0.7 0.7 1.5 0.7 

12.5 7.4 3.1 3.0 5.3 3.1 
4.4 10.3 4.4 2.3 3.7 2.6 

1.8 11.4 4.3 1^ i^S 2.5 
0.5 8.2 1.3 1.0 0.5 0.8 



38.2 
0.0 
0.0 

41.0 

10.3 
0.0 
0.0 

12.5 
2.8 
0.0 
0.0 
3.6 
1.9 
0.0 
0.0 
3.0 
0.7 
0.0 
OO 
1.0 
0.2 
0.0 
0.0 
0.2 



1.3 
(1.(1 
0.0 
1.9 
1.6 
0.0 
0.0 
2.1 
1.5 
0.0 
0.0 
1.9 
1.6 
0.0 
0.0 
2.0 
0.6 
0.0 
0.0 
1.0 
0.2 
0.0 
0.0 
0.6 



1.3 1.3 2.0 

0.0 0.0 0.0 

0.0 0.0 0.0 

1.9 1.9 2.8 

2.7 2.7 2.4 

0.0 0.0 0.0 

0.0 0.0 OO 

2.3 2.3 2A) 

2.2 2.2 1.8 

0.0 0.0 0.0 

OO 0.0 OO 

1.9 2.0 2.0 

1.5 1.5 1.5 

0.0 0.0 0.0 

0.0 0.0 0.0 

2.1 1^ 2.1 

0.7 0.6 0.8 

0.0 0.0 0.0 

OO 0.0 OA) 

1.1 1.1 06 

0.1 0.2 0.1 

0.0 0.0 0.0 

OO OO OO 

0.4 0.4 0.2 



2.0 
0.0 
0.0 
2.8 
2.8 
0.0 
0.0 
2.8 
2.2 
0.0 
0.0 
2.0 
1.2 
0.0 



2.4 2.0 

0.1 OA) 

1.4 0.9 

0.6 04 

0.8 0.8 

1.2 1.2 

1.8 1.8 

1.8 1.0 



41. 
19. 
215. 
41. 



1 6.0 

5 OO 
3 0.0 
9 6.2 

6 4.6 
OO 



3.3 2.4 2.4 2.2 1^ 2.1 

17.9 10.2 3.2 1.6 2.9 1.8 

21.6 0.5 OS 0.5 0.6 0.5 

22.2 1.3 0.7 0.7 1.3 0.7 

13.6 7.9 3.5 3.5 5.6 3.5 

4.2 9.8 4.6 3.0 3.9 3.6 

2.0 10.9 4.3 2.0 2.0 1^ 

0.0 7.3 3.2 1.8 0.8 1.8 



0.0 

1 5.0 
2.6 
0.0 



0.0 1038 

2.1 5 

0.4 7 

0.0 



9.7 0.0 

6.6 3.2 

4.2 1.9 

0.0 0.0 

3 0.0 

3 2.3 

7 0.4 

OA) 



0.0 3161. 

0.7 9. 

0.1 10. 

0.0 14. 

0.0 3604. 

0.3 6. 



5 0.0 
4 1.2 
4 0.3 
9 OA) 

6 OA) 
6 0.6 



36.8 
0.0 
0.0 

42.8 

11.1 
0.0 
0.0 

14.7 
3.0 
0.0 
OO 
3.5 
2.0 
0.0 
OO 
3.9 
1.0 
0.0 
0.0 
1.6 
0.2 
0.0 
0.0 
0.3 



2.4 
0.0 
0.0 
2.9 
2.8 
0.0 
0.0 
3.6 
2.2 
0.0 
0.0 
3.1 
2.2 
0.0 
0.0 
2.3 
0.8 
0.0 
0.0 
1.1 
0.3 
0.0 
0.0 
0.6 



2.2 2.3 

0.0 (1.(1 

0.0 0.0 

2.8 2^ 

2.8 2.8 
0.0 0.0 
0.0 0.0 
3.4 3.4 
2.0 2.2 
0.0 0.0 
0.0 0.0 

2.9 2.9 
1.9 1.8 
0.0 0.0 
0.0 0.0 
1.8 2.1 
0.2 0.8 
0.0 0.0 
0.0 0.0 
0.7 0.8 
0.2 0.3 
0.0 0.0 
0.0 0.0 
0.3 0.6 



3.0 2.9 

0.0 (1.(1 

0.0 OO 

3.7 3.7 

3.6 3.1 

0.0 0.0 

0.0 0.0 

3.3 3.5 

2.5 2.2 
0.0 0.0 
0.0 0.0 

3.6 2J) 

1.4 1.9 
0.0 0.0 
OO 0.0 

2.6 u: 

0.8 0.3 

0.0 0.0 

0.0 0.0 

1.0 0.9 

0.2 02 

0.0 0.0 

0.0 0.0 

0.1 0.3 



2.5 
0.1 

1.2 
0.6 
0.8 
1.2 
2.0 
2.1 

36.8 
2.9 
7.2 

42.8 

12.3 
0.0 
0.0 

12.6 
8.0 
0.0 
0.0 

13.7 



0.0 
0.0 
6.7 
9.2 
0.0 
9.2 
13.0 
9.9 
1.4 
9.0 



2.2 
0.0 

0.9 
0.4 
0.8 
1.2 
2.0 
1.3 

10.1 
0.0 
0.0 

10.3 
7.3 
0.0 
0.0 
7.8 
4.2 
0.0 
0.0 
4.6 
2.3 
0.0 
0.0 
2.6 
0.9 
0.0 
0.0 
1.1 
0.3 
0.0 
0.0 
0.4 



All avg. 
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Clique avg. 
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Gcom. avg. 
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Product avg. 
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SR avg. 


17 


7 


1 
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2 


4 
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2 


4 


5 


10 


2 


1.6 


1 


6 


1 
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6 


1 


8 


13 


2 


3 


1 


11 


1 


2 


2 


2^ 





2 


1 


2 


4 


2 


2 


16 
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3-AP avg. 


38 


4 


1 


2 


1 


2 


1 
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1 


7 


1 


7 
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4 


8 


19 


8 


0.8 
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4-AP avg. 
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5-AP avg. 
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3 


1 


5 


1 


6 


1 


3 


1 


2 


1 


3 


1 


5 


1 


3 


5 
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6-AP avg. 


1 
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1 
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9 





8 


262 





1 
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7-AP avg. 
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4 
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8-AP avg. 





2 
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1 





1 


909 


1 
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1 
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1 
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Ji 





1 


7 


5 



4.2 
0.0 
0.0 
4.5 

6.1 
3.8 
2.2 

1.2 
0.5 
0.2 
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Table A. 25: All MAP heuristics comparison for the instances with independent weights. 



Inst. 


< 10 ms 


< 30 ms 


< 100 ms 


< 300 ms 


< 1000 ms 










C sDV 0.0 












C 2DV2 0.0 








C sDV Gr 1.4 




C sDVv 0.0 




3rl50 




C sDV 1.5 


C sDVv 0.3 


C sDVv Gr 0.0 


(no better sol.) 






C2DV2 1.5 




C sDV R 0.0 
C2DV2R 0.0 
CsDVv R 0.0 


4r80 


C IDV 25.8 


sDV Gr 6.1 
2DV2Gr 6.1 

2DV Gr 13.5 


sDVv Gr 1.5 


C sDVv Gr 0.3 


C sDVv 0.0 
C sDVv Gr 0.0 
C sDVv R 0.0 


5r40 


IDV2 Gr 15.0 


sDV Gr 13.5 


CsDVv 1.2 


C sDVv 0.0 


(no better sol.) 






2DV2 Gr 13.5 






6r22 


C 2DV 46.4 
C sDV 47.3 


2-opt Gr 25.9 


CsDVvGr 1.4 


C sDVv Gr 0.0 
C sDVv 0.0 


(no better sol.) 


7rl4 


C 2-opt Gr 28.6 


C sDVv Gr 13.6 


CsDVv 1.4 


MC sDVv 0.0 
C sDVv Gr 0.0 


(no better sol.) 


8r9 


C 2-opt Gr 22.2 
C 2-opt 24.4 


C sDVv 12.2 


C sDVv 0.0 


(no better sol.) 


(no better sol.) 






C sDV Gr 18.6 






C sDVv 0.0 
C sDVv Gr 0.0 


Total 




C 2DV2 Gr 19.3 
C sDV 20.2 


C sDVv Gr 4.8 


CsDVv Gr 0.1 
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Tabk^ A. 26: All MAP iKniristics comparison for the instance's with ckx'oinposablc weights. 



Inst. 
3cql50 

3srl50 

4cq50 

4sr50 
5cq30 

5sr30 

6cql8 
6srl8 

7cql2 

7srl2 
8cq8 



8sr8 



< 100 ms 



sDV Gr 8.1 



: sDV Gr 
sDV Gr 
IDV2 Gr 



9.6 
9.8 
9.8 



C 2DV2 Gr 10.2 



C IDV 
MC IDV 
CIDV2 



C IDV 
MC IDV 



C IDV 
MC IDV 



MC IDV 
C IDV 



C IDV 

MC IDV 
C IDV 



C IDV 



C IDV 
C IDV 



C IDV 



9.7 
10.0 
10.3 



11.7 
12.2 



6.3 
6.4 



7.9 
8.3 



1.2 



0.3 



< 300 ms 

C sDV Gr 7.8 
C 2DV2 Gr 7.8 



C sDV Gr8.4 
C2DV2 Gr8.4 



MC IDV Gr6.4 
MC IDV 6.9 



MC IDV Gr7.0 



< 1000 ms 

MC sDV Gr6.6 
MC 2DV2Gr7.1 



< 3000 ms 

MC sDV Gr3.1 
MC 2DV2 Gr 3.4 



< 10000 ms 



MC sDV Gr 1.3 



MC sDV Gr6.6 MC sDV Gr3.5 MC sDV Gr 2.0 



MC IDV 



MC IDV 



7.7 



3.2 



MC IDV Gr4.7 
MCIDV2 Gr4.9 
MC IDV 5.0 
MC sDV R 5.1 
MCIDV2R 5.1 

MC IDV Gr4.7 
MCIDV2 Gr5.0 



MC IDV Gr2.7 MC IDV Gr 1.5 



MC IDV Gr2.6 
MCIDV2 Gr2.7 



MC IDV2 Gr 2.0 
MC IDV 2.0 
MC IDV Gr 2.1 
MC IDV M-R2.1 



MC 2DV 
MC IDV 
MC sDV 



MC IDV 3.9 MC IDV 



2.6 
2.6 
2.7 



3.2 



MC 2DV 
MC sDV 



1.7 
1.7 



2.1 C IDV 

3.8 MC IDV 
3.8 C IDV 



0.7 C IDV 



C IDV 
CIDV2 



0.0 C IDV 



1.0 



2.1 
2.1 



0.2 



0.5 
0.5 

0.0 



C IDV 0.7 

C 2DV 1.4 
C2DV2R 1.5 



MCIDV2 Gr2.4 
MC 2DV Gr2.5 
MC sDV Gr2.5 
MC IDV 2.5 
MC 2DV2 Gr2.6 

C 2DV GrO.3 
C IDV 0.8 



MC sDV 
MC 2DV 
MC 2DV2 

MC 2DV Gr 
MC IDV Gr 
MC sDV Gr 
MC 2DV2 Gr 
MC IDV2 Gr 



1.3 
1.3 
1.3 

1.9 
1.9 
2.0 
2.0 
2.0 



C sDV Gr 0.0 



C sDV Gr 0.3 



CIDV2 0.1 C IDV 0.0 



C IDV 
C2DV2 
C IDV Gr 
C IDV2 Gr 
C IDV R 
C 2DV R 
C sDV R 
C 2DV2 R 



0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 
0.0 



C IDV R 0.1 C 2DV 0.0 (no better sol.) 
(no better sol.) (no better sol.) (no better sol.) 



C IDV 
C 2DV 

CIDV2 
C2DV2 



0.0 
0.0 
0.0 
0.0 



C IDV 
C 2DV 



0.0 
0.0 



C IDV GrO.O 
CIDV2 GrO.O 
C2DV2 GrO.O 
C 2-opt R 0.0 
C IDV R 
C 2DV R 
C IDV2 R 
C 2DV2 R 



(no better sol.) (no better sol.) 



0.0 
0.0 
0.0 

0.0 



Total 



C IDV 



6.4 



C IDV 
C 2DV 



4.5 
5.0 



MC IDV 3.5 

MC 2DV 3.7 

C 2DV 3.7 

MC IDV R 3.8 



MC IDV Grl.9 
MC 2DV Gr2.1 
MC sDV Gr2.1 
MC IDV2 Gr2.1 



MC IDV Gr 1.3 
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Table A. 27: GTSP metaheuristics quality comparison. 



Error, % Quality impr., % Opt., % 





GK 


SG 


SD 


TSP 


SG 


SD 


TSP 


GK 


SD 


TSP 


40dl98 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


100 


100 


100 


40kroa200 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


100 


100 


100 


40krob200 


0.00 


0.05 


0.01 


0.00 


0.05 


0.01 


0.00 


100 


70 


100 


41gr202 


0.00 




0.00 






0.00 




100 


100 




45ts225 


0.00 


0.14 


0.09 


0.04 


0.14 


0.09 


0.04 


100 





60 


45tsp225 


0.00 




0.01 






0.01 




100 


90 




46pr226 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


100 


100 


100 


46gr229 


0.00 




0.03 






0.03 




100 


60 




53gil262 


0.00 


0.45 


0.31 


0.32 


0.45 


0.31 


0.32 


100 


30 


60 


53pr264 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


0.00 


100 


100 


100 


56a280 


0.00 


0.17 


0.08 




0.17 


0.08 




100 


70 




60pr299 


0.00 


0.05 


0.05 


0.03 


0.05 


0.05 


0.03 


100 


20 


60 


641iu318 


0.00 


0.00 


0.38 


0.46 


0.00 


0.38 


0.46 


100 


50 


60 


65rbg323 (asym.) 


0.00 














100 






72rbg358 (asym.) 


0.00 














100 






80rd400 


0.00 


0.58 


0.60 


0.91 


0.58 


0.60 


0.91 


100 





20 


81rbg403 (asym.) 


0.00 














100 






84fl417 


0.00 


0.04 


0.02 


0.00 


0.04 


0.02 


0.00 


100 


40 


100 


87gr431 


0.00 




0.30 






0.30 




100 


40 




88pr439 


0.00 


0.00 


0.28 


0.00 


0.00 


0.28 


0.00 


100 


20 


80 


89pcb442 


0.00 


0.01 


1.30 


0.86 


0.01 


1.30 


0.86 


100 








89rbg443 (asym.) 


0.13 














50 






99d493 


0.11 


0.47 


1.28 




0.36 


1.17 




10 







107ali535 


0.00 




1.36 






1.36 




100 







107att532 


0.01 


0.35 


0.72 




0.34 


0.72 




80 







1 n7ail^'?^ 
lU / blOoO 


u.uu 


U.UO 






n ns 


u.oz 




1 nn 


u 




113pa561 


0.00 


1.50 


3.57 




1.50 


3.57 




100 







115u574 


0.02 




1.54 






1.52 




80 







115rat575 


0.20 


1.12 


3.22 




0.93 


3.03 




90 







131p654 


0.00 


0.29 


0.08 




0.29 


0.08 




100 







132d657 


0.15 


0.45 


2.32 




0.29 


2.16 




30 







134gr666 


0.11 




3.74 






3.62 




70 







145u724 


0.14 


0.57 


3.49 




0.43 


3.35 




50 







157rat783 


0.11 


1.17 


3.84 




1.06 


3.72 




20 







200dsjl000 


0.12 




2.45 






2.33 




30 







201prl002 


0.14 


0.24 


3.43 




0.10 


3.29 




30 







207sil032 


0.03 


0.37 


0.93 




0.34 


0.91 




20 







212ul060 


0.27 


2.25 


3.60 




1.98 


3.33 




30 







217vml084 


0.19 


0.90 


3.68 




0.71 


3.49 




60 







Pull IS average 


0.04 














81 






Sym. IS average 


0.05 




1.43 






1.38 




77 


16 




SG IS average 


0.06 


0.54 


1.57 




0.47 


1.50 




72 


11 




TSP IS average 


0.00 


0.21 


0.45 


0.44 


0.21 


0.45 


0.44 


100 


17 


43 
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Table A. 28: GTSP metaheuristics running time comparison. 



Time, sec Time impr., % 





GK 


SG 


SD 


TSP 


SG 


SD 


TSP 


40dl98 


0.14 


1.63 


1.18 


1.22 


11.6 


8.4 


8.7 


40kroa200 


0.14 


1.66 


0.26 


0.79 


12.1 


1.9 


5.8 


40krob200 


0.16 


1.63 


0.80 


2.70 


10.2 


5.0 


16.8 


41gr202 


0.21 




0.65 






3.2 




45ts225 


0.24 


1.71 


0.46 


1.42 


7.0 


1.9 


5.8 


45tsp225 


0.19 




0.55 






2.9 




46pr226 


0.10 


1.54 


0.63 


0.46 


15.5 


6.4 


4.6 


46gr229 


0.25 




1.14 






4.6 




53gil262 


0.31 


3.64 


0.85 


4.51 


11.7 


2.7 


14.5 


53pr264 


0.24 


2.36 


0.82 


1.10 


10.0 


3.5 


4.7 


56a280 


0.38 


2.92 


1.14 




7.7 


3.0 




60pr299 


0.42 


4.59 


1.74 


3.08 


10.9 


4.1 


7.3 


641iu318 


0.45 


8.08 


1.42 


8.49 


18.1 


3.2 


19.0 


65rbg323 (asym.) 


1.14 














72rbg358 (asym.) 


1.26 














80rd400 


1.07 


14.58 


3.53 


13.55 


13.7 


3.3 


12.7 


81rbg403 (asym.) 


0.98 














84fl417 


0.73 


8.15 


3.17 


6.74 


11.1 


4.3 


9.2 


87gr431 


2.01 




4.01 






2.0 




88pr439 


1.48 


19.06 


4.68 


20.87 


12.9 


3.2 


14.1 


89pcb442 


1.72 


23.43 


4.26 


23.14 


13.6 


2.5 


13.4 


89rbg443 (asym.) 


3.69 














99d493 


4.17 


35.72 


6.34 




8.6 


1.5 




107ali535 


5.82 




7.75 






1.3 




107att532 


3.45 


31.70 


8.04 




9.2 


2.3 




1 n7ail^'?^ 
lU / blOoO 


±.oo 


zo.oo 


O.UD 




141:. 1 






113pa561 


3.22 


21.08 


6.37 




6.5 


2.0 




115u574 


3.76 




11.48 






3.1 




115rat575 


4.12 


48.48 


9.19 




11.8 


2.2 




131p654 


2.82 


32.67 


13.23 




11.6 


4.7 




132d657 


6.82 


132.24 


15.40 




19.4 


2.3 




134gr666 


14.46 




21.06 






1.5 




145u724 


11.61 


161.82 


22.00 




13.9 


1.9 




157rat783 


15.30 


152.15 


22.70 




9.9 


1.5 




200dsjl000 


50.14 




84.30 






1.7 




201prl002 


34.83 


464.36 


63.04 




13.3 


1.8 




207sil032 


36.76 


242.37 


34.99 




6.6 


1.0 




212ul060 


44.76 


594.64 


65.81 




13.3 


1.5 




217vml084 


59.82 


562.04 


87.38 




9.4 


1.5 




Pull IS total 


321.0 














Sym. IS total/average 


314.0 




516.4 






2.9 




SG IS total/average 


237.1 


2600.6 


385.5 




11.6 


3.0 




TSP IS total/average 


7.2 


92.1 


23.8 


88.1 


12.2 


3.9 


10.5 
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Table A. 29: GK experiments details. 



Name 


Opt. 


Value 


Error, % 


Opt., % 


Time, sec 


# gen. 


Zl Orl 1 Qk 




1 n^^7 


n on 


1 nn 


n 14 


Q 1 






1 Q/inK n 
±o'±uo.u 


u.uu 


1 nn 
±uu 


n 1 4 


Q n 
y .u 




13111 


13111.0 


n on 


1 nn 


n 16 


1 n 3 




ZOOU± 


oQQoi n 

ZOOUl.U 


n no 
u.uu 


1 nn 

lUU 


n 91 
u.z± 


y.o 








n no 

u.uu 


1 nn 

lUU 


n OA 


19 7 




1 fil 9 


1 fil 9 n 


n on 

u.uu 


1 nn 

lUU 


n 1 Q 

u. ±y 


1 n 4 




u^uu / 


f>zinn7 

u^uu / .u 


on 

u.uu 


1 nn 

lUU 


n in 

U. lU 


Q n 

y .u 


4fio-r99Q 


71 Q79 


71Q79 n 


n on 

u.uu 


1 nn 

lUU 


n 9^ 

u.zo 


y .u 


p;Qa-Tl9(^9 


iu±o 


1 ni n 


n nn 
u.uu 


1 nn 

lUU 


n "^1 


19 9 
±z.z 


f^'^nr9(^zl 






n on 

u.uu 


1 nn 

lUU 


n 94 


Q 1 
y . 1 


'=ififi9Rn 

OUcLZOU 


1 n7Q 


1 n7Q n 


n on 

u.uu 


1 nn 

lUU 


n 


1 1 


oupi zyy 


99R1 ^ 


99f!i n 


n nn 
u.uu 


1 nn 

lUU 


n 49 


1 1 Q 
i 1 .y 






9n7f;^ n 

ZVJ / uo.u 


n nn 

u.uu 


1 nn 

lUU 


n A^ 


1 9 




471 


A71 n 


n nn 
u.uu 


1 nn 
±uu 


1 14 


97 S 
Z ( .o 






oyo.u 


n nn 
u.uu 


1 nn 

lUU 


1 9(^ 
1 .zo 


94 4 


Knrri4nn 

OUi U-^UL/ 


UOU J. 


fi'^fil n 

UOW J. .u 


n nn 

u.uu 


1 nn 

-LUU 


1 n? 

X .u / 


1 ^ n 


Oil ugftuo I dbyiii. 1 


1 1 70 


1 1 70 n 


n nn 

u.uu 


1 nn 

lUU 


n Qj^ 

u.yo 


Ifi 1 


o/ifl/i 1 7 


yoo± 




n nn 
u.uu 


1 nn 

lUU 


n 7"^ 
u. ( o 


11"^ 

11.0 


O ( ^141:01 


1 m QzLR 




n nn 
u.uu 


1 nn 
±uu 


9 ni 

Z.Ul 


1 7 7 
1 i . / 


oopi^ioy 






n nn 
u.uu 


1 nn 

lUU 


1 4R 


Ifi 
ID.O 


O y p (-J ^ 


91 fi'i7 


91 f!'i7 n 


n nn 

u .uu 


1 nn 

-LUU 


1 79 


91 9 

Z< -L . Z< 


^QrVicrZLzl'^ f'QQ-\7"m 




UOZi.O 


n 1 

U. -LO 


o\j 


o.uy 


oo.o 


yyci^tyo 






nil 

U. 1 ± 


1 n 

±U 


4 17 


97 
Z ( .o 


lU ( djilOOO 






n nn 
u.uu 


1 nn 
±uu 


J59 


9^; 1 

zo. 1 


107att532 


13464 


13464.8 


0.01 


80 


3.45 


22.2 


107si535 


13502 


13502.0 


0.00 


100 


1.88 


19.5 


113pa561 


1038 


1038.0 


0.00 


100 


3.22 


22.2 


115u574 


16689 


16691.8 


0.02 


80 


3.76 


25.3 


115rat575 


2388 


2392.7 


0.20 


90 


4.12 


25.7 


131p654 


27428 


27428.0 


0.00 


100 


2.82 


15.3 


132d657 


22498 


22532.8 


0.15 


30 


6.82 


30.3 


134gr666 


163028 


163210.7 


0.11 


70 


14.46 


41.0 


145u724 


17272 


17296.8 


0.14 


50 


11.61 


38.9 


157rat783 


3262 


3265.7 


0.11 


20 


15.30 


40.1 


200dsjl000 


9187884 


9198846.6 


0.12 


30 


50.14 


49.1 


201prl002 


114311 


114466.2 


0.14 


30 


34.83 


46.8 


207sil032 


22306 


22312.0 


0.03 


20 


38.40 


45.0 


212ul060 


106007 


106290.1 


0.27 


30 


44.76 


50.4 


217vml084 


130704 


130954.2 


0.19 


60 


59.82 


50.5 


Average 






0.04 


81 




23.1 
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Table A. 30: Comparison of the MAP Memetic Algorithm based on different local search 
procedures. The given time is 3 s. 



Relative solution error, % 



Inst. 


Best 


2-opt 


IDV 


2DV 


sDV 


IDV2 


2DV2 


SDV3 


sDVv 


3r40 


40, 


.0 


122.00 


26.75 


30.00 


27.25 


32.25 


32.50 


32.00 


6.25 


3r70 


70, 


.0 


102.71 


11.43 


11.14 


11.57 


11.71 


11.57 


15.00 


0.71 


3rl00 


100 


.0 


83.90 


3.00 


3.20 


3.10 


3.30 


3.10 


5.80 


0.00 


4r20 


20, 


.0 


68.00 


46.00 


28.00 


29.50 


39.50 


32.00 


17.50 


0.00 


4r30 


30, 


.0 


73.00 


31.00 


23.67 


23.67 


27.00 


21.67 


14.33 


0.00 


4r40 


40, 


.0 


73.50 


24.00 


15.25 


15.00 


23.00 


15.75 


11.25 


0.00 


5rl5 


15, 


.0 


oo.o / 


oy.oo 




1 fi fi7 
lO.O / 


22 00 


^ J..OO 


o.uu 


n no 

u.uu 


5rl8 


18, 


.0 


40.56 


37.78 


20.56 


19.44 


26.11 


18.89 


2.78 


0.00 


5r25 


25, 


.0 


40.40 


34.00 


16.80 


16.80 


25.60 


18.40 


3.60 


0.00 


6rl2 


12, 


.0 


10.00 


39.17 


15.83 


10.00 


14.17 


13.33 


0.83 


0.00 


6rl5 


15, 


.0 


22.00 


45.33 


16.67 


11.33 


18.67 


13.33 


0.00 


0.00 


6rl8 


18, 


.0 


23.89 


37.22 


18.33 


10.00 


17.22 


12.78 


0.00 


0.00 


All avg. 






58.05 


31.25 


18.23 


16.19 


21.71 


17.89 


9.26 


0.58 


3-AP avg. 




102.87 


13.73 


14.78 


13.97 


15.75 


15.72 


17.60 


2.32 


4-AP avg. 




71.50 


33.67 


22.31 


22.72 


29.83 


23.14 


14.36 


0.00 


5-AP avg. 




39.21 


37.04 


18.90 


17.64 


24.57 


19.54 


4.79 


0.00 


6-AP avg. 




18.63 


40.57 


16.94 


10.44 


16.69 


13.15 


0.28 


0.00 


Small avg. 




59.17 


37.81 


23.29 


20.85 


26.98 


24.79 


14.58 


1.56 


Moderate avg 




59.57 


31.38 


18.01 


16.50 


20.87 


16.37 


8.03 


0.18 


Large avg. 




55.42 


24.56 


13.40 


11.23 


17.28 


12.51 


5.16 


0.00 


3cq40 


939, 


.9 


VlAh 


0.05 


0.01 


0.10 


0.04 


0.11 


2.60 


0.31 


3sr40 


610 


.6 


15.39 


0.05 


0.23 


0.07 


0.23 


0.25 


2.46 


0.23 


3cq70 


1158 


,4 


37.92 


3.84 


3.98 


3.43 


4.72 


4.63 


10.50 


5.94 


3sr70 


737, 


,1 


44.15 


4.79 


5.28 


5.70 


4.94 


5.06 


14.30 


6.46 


3cql00 


1368, 


,1 


47.09 


8.19 


7.92 


8.29 


8.61 


8.82 


15.04 


10.55 


3srl00 


866, 


.3 


46.02 


7.92 


7.77 


7.61 


8.50 


8.48 


14.71 


11.06 


4cq20 


1901, 


.8 


0.27 


0.01 


0.02 


0.03 


0.08 


0.06 


1.16 


0.27 


4sr20 


929, 


.3 


0.40 


0.01 


0.12 


0.03 


0.14 


0.03 


0.85 


0.36 


4cq30 


2281, 


.9 


5.53 


0.41 


0.69 


0.69 


0.67 


0.73 


5.26 


1.77 


4sr30 


535, 


.1 


20.15 


5.05 


2.15 


2.32 


4.20 


2.39 


9.81 


5.12 


4cq40 


2606, 


.3 


14.53 


2.98 


1.96 


2.47 


2.90 


3.49 


9.04 


6.85 


4sr40 


1271, 


.4 


19.85 


5.86 


5.15 


4.41 


5.33 


4.62 


13.43 


9.32 


5cql5 


3110, 


7 


0.01 


0.00 


0.00 


0.00 


0.00 


0.00 


1.53 


0.01 


5srl5 


1203, 


.9 


0.24 


0.02 


0.00 


0.02 


0.04 


0.00 


2.22 


0.10 


5cql8 


3458, 


.6 


0.30 


0.00 


0.04 


0.04 


0.02 


0.00 


2.90 


0.30 


5srl8 


504, 


.9 


3.72 


1.47 


0.04 


0.00 


0.28 


0.24 


4.12 


0.61 


5cq25 


4192, 


.7 


4.03 


0.25 


0.54 


0.54 


0.86 


0.87 


6.82 


2.71 


5sr25 


1627, 


.5 








1 1 A 


U.Oo 


1 97 


tS.ol 


o.yu 


6cql2 


4505, 


.6 


0.08 


0.00 


0.00 


0.00 


0.00 


0.00 


2.49 


0.08 


6srl2 


502, 


.9 


0.18 


0.12 


0.00 


0.00 


0.00 


0.00 


2.62 


0.08 


6cql5 


5133 


.4 


0.58 


0.00 


0.09 


0.08 


0.06 


0.13 


4.98 


0.23 


6srl5 


1654, 


.6 


1.12 


0.24 


0.42 


0.19 


0.24 


0.43 


4.93 


1.21 


6cql8 


5765, 


.5 


1.57 


0.42 


0.50 


0.51 


0.22 


0.42 


6.55 


1.87 


6srl8 


1856, 


.3 


2.33 


0.39 


0.68 


1.07 


0.77 


0.85 


6.62 


1.93 


All avg. 






11.77 


1.77 


1.61 


1.61 


1.81 


1.79 


6.39 


2.97 


Clique avg. 




10.36 


1.35 


1.31 


1.35 


1.52 


1.60 


5.74 


2.58 


SR avg. 






13.19 


2.20 


1.91 


1.88 


2.10 


1.97 


7.03 


3.37 


3-AP av) 






33.84 


4.14 


4.20 


4.20 


4.51 


4.56 


9.93 


5.76 


4-AP avg. 




10.12 


2.39 


1.68 


1.66 


2.22 


1.89 


6.59 


3.95 


5-AP avg. 




2.16 


0.36 


0.28 


0.29 


0.30 


0.40 


4.32 


1.27 


6-AP avg. 




0.98 


0.19 


0.28 


0.31 


0.21 


0.30 


4.70 


0.90 


Small av 


g- 




3.63 


0.03 


0.05 


0.03 


0.07 


0.06 


1.99 


0.18 


Moderate avg 




14.18 


1.97 


1.59 


1.56 


1.89 


1.70 


7.10 


2.71 


Large av 


g- 




17.51 


3.31 


3.20 


3.25 


3.47 


3.60 


10.07 


6.03 
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Table A. 31: MAP metaheuristics comparison for small running times. 



Relative solution error, % 





0.3 sec. 






1 sec. 






3 sec. 




Instance 


HL 


SA 


GK 


HL 


SA 


GK 


HL 


SA 


GK 


3r40 


49.75 


120.00 


10.75 


44.25 


99.00 


9.75 


41.50 


84.50 


6.25 


3r70 


512.86 


102.86 


3.29 


18.14 


82.86 


1.71 


16.86 


72.71 


0.71 


3rl00 


5051.50 


100.30 


1.10 


15.40 


70.10 


0.20 


4.90 


59.20 


0.00 


4r20 


73.50 


153.50 


6.00 


71.00 


133.00 


0.50 


59.00 


100.50 


0.00 


4r30 


56.67 


126.33 


2.00 


50.33 


114.00 


0.00 


45.00 


94.00 


0.00 


4r40 


38.00 


121.75 


0.75 


33.00 


110.75 


0.00 


28.75 


91.50 


0.00 


5rl5 


75.33 


163.33 


0.67 


63.33 


126.67 


0.00 


52.00 


124.00 


0.00 


5rl8 


72.22 


158.33 


0.56 


62.78 


139.44 


0.00 


53.89 


107.78 


0.00 


5r25 


60.40 


164.00 


0.40 


51.20 


118.80 


0.00 


44.80 


103.60 


0.00 


6rl2 


76.67 


184.17 


0.00 


62.50 


115.00 


0.00 


48.33 


110.83 


0.00 


6rl5 


72.00 


154.00 


0.00 


50.67 


130.67 


0.00 


45.33 


105.33 


0.00 


6rl8 


62.22 


176.67 


0.00 


55.00 


126.11 


0.00 


45.00 


107.22 


0.00 


All avg. 


516.76 


143.77 


2.13 


48.13 


113.87 


1.01 


40.45 


96.77 


0.58 


3-AP avg. 


1871.37 


107.72 


5.05 


25.93 


83.99 


3.89 


21.09 


72.14 


2.32 


4-AP avg. 


56.06 


133.86 


2.92 


51.44 


119.25 


0.17 


44.25 


95.33 


0.00 


5-AP avg. 


69.32 


161.89 


0.54 


59.10 


128.30 


0.00 


50.23 


111.79 


0.00 


6-AP avg. 


70.30 


171.61 


0.00 


56.06 


123.93 


0.00 


46.22 


107.80 


0.00 


Small avg. 


68.81 


155.25 


4.35 


60.27 


118.42 


2.56 


50.21 


104.96 


1.56 


Moderate avg. 


178.44 


135.38 


1.46 


45.48 


116.74 


0.43 


40.27 


94.96 


0.18 


Large avg. 


1303.03 


140.68 


0.56 


38.65 


106.44 


0.05 


30.86 


90.38 


0.00 



3cq40 


6, 


.60 


22, 


,69 


1.23 


5, 


.19 


16, 


,95 


0.52 


3, 


,14 


9, 


,68 


0: 


10 


3sr40 


6, 


.55 


27, 


,10 


1.87 


5, 


.11 


18, 


,18 


0.74 


4, 


,44 


15, 


,92 


0, 


,07 


3cq70 


585, 


.22 


53, 


.63 


8.66 


13, 


.51 


40, 


,72 


6.. 38 


11, 


,93 


33, 


,29 


3, 


,43 


3sr70 


744, 


.70 


58, 


,53 


8.97 


15, 


.63 


44, 


,69 


7.15 


15, 


,00 


39, 


,52 




.70 


3cql00 


1013, 


.95 


68, 


,28 


11.94 


1013, 


.95 


60, 


,25 


10.20 


16, 


,10 


48, 


,53 


8, 


,29 


3srl00 


1017, 


.18 


83, 


,18 


11.25 


815, 


.17 


69, 


,14 


10.27 


17, 


,16 


56, 


,14 


7, 


.61 


4cq20 


1, 


.71 


15, 


,53 


0.07 


1, 


.35 


12, 


.28 


0.03 


0, 


,87 


10, 


,48 


0, 


,03 


4sr20 


3, 


.58 


10, 


,47 


0.33 


2, 


.16 


7, 


,17 


0.31 


1, 


,42 


5, 


,00 




.03 


4cq30 


7, 


.51 


30, 


,65 


2.66 


6, 


.66 


21, 


,57 


0.91 


5, 


,64 


18, 


,21 


a 


,69 


4sr30 


19, 


.59 


45, 


.32 


5.44 


16, 


.22 


35, 


.47 


4.15 


15, 


.10 


27. 


,51 


2, 


.32 


4cq40 


17. 


.90 


37, 


.87 


6.80 


11, 


.60 


34. 


.76 


4.46 


10, 


.41 


28. 


.53 


2, 


.47 


4sr40 


18, 


.26 


38, 


.32 


10.20 


15, 


.74 


28, 


.83 


7.79 


14, 


.62 


23. 


,08 


4, 


.41 


5cql5 





.95 


30, 


.11 


0.07 


0, 


.41 


29, 


.80 


0.03 


0, 


.20 


28. 


,66 


Q: 


.00 


5srl5 


3 


.11 


30, 


.87 


0.47 


2, 


.04 


30, 


.25 


0.09 


1. 


.37 


29. 


,88 


0, 


.02 


5cql8 


2, 


.41 


38, 


.73 


0.57 


2, 


.17 


38, 


.26 


0.20 


1, 


.27 


36. 


.40 


0: 


.04 


5srl8 


15, 


.35 


131, 


.47 


1.37 


13, 


.77 


128. 


.70 


0.63 


12, 


.16 


128. 


.03 


0, 


.00 


5cq25 


7, 


.52 


48, 


.11 


3.84 


6, 


.11 


45, 


.41 


1.97 


5, 


.00 


45. 


,06 


0: 


.54 


5sr25 


9, 


.23 


47, 


.75 


4.85 


8, 


.65 


44, 


.80 


2.82 


6, 


.97 


43. 


,62 


L 


Ji 


6cql2 


0, 


.62 


35, 


.66 


0.24 


0, 


.08 


35, 


.55 


0.00 


0, 


.01 


35, 


,18 


0, 


.00 


6srl2 


7, 


.91 


111, 


,81 


0.18 


6, 


.64 


110, 


,34 


0.04 


5, 


,67 


109, 


,96 


(1 


.00 


6cql5 


2, 


.26 


43, 


,66 


1.43 


1, 


.58 


43, 


,68 


0.32 


1, 


,31 


42, 


,22 


0, 


.08 


6srl5 


3 


.05 


40, 


,14 


1.94 


2, 


.34 


39, 


,75 


0.86 


1, 


,72 


39, 


,68 




.19 


6cql8 


3 


.91 


51, 


.19 


15.43 


2, 


.48 


49, 


.98 


1.43 


1, 


.90 


48, 


,95 


a 


.51 


6srl8 


5, 


.83 


48, 


.13 


13.20 


4, 


.92 


47, 


.52 


2.02 


3, 


.93 


47. 


,38 


L 


.m 


All avg. 


146, 


.04 


47. 


.88 


4.71 


82, 


.23 


43. 


.09 


2.64 


6. 


.56 


39. 


.62 


L 


.61 


Clique avg. 


137, 


.55 


39, 


.68 


4.41 


88, 


.76 


35, 


.77 


2.20 


4, 


.82 


32. 


,10 


L 


.35 


SR avg. 


154 


.53 


56, 


.09 


5.01 


75, 


.70 


50, 


.40 


3.07 


8, 


.30 


47. 


,14 


L 


.88 


3-AP avg. 


562, 


.37 


52, 


.24 


7.32 


311, 


.43 


41, 


,66 


5.88 


11, 


,30 


33, 


,85 




,20 


4-AP avg. 


11, 


.43 


29, 


,69 


4.25 


8, 


.95 


23, 


,35 


2.94 


8, 


,01 


18, 


,80 


1, 


,66 


5-AP avg. 


6, 


.43 


54, 


,51 


1.86 


5, 


.52 


52, 


,87 


0.96 


4, 


,49 


51, 


,94 




.29 


6-AP avg. 


3, 


.93 


55, 


,10 


5.40 


3, 


.01 


54, 


,47 


0.78 


2, 


,42 


53, 


,89 


a 


.31 


Small avg. 


3, 


.88 


35, 


,53 


0.56 


2, 


.87 


32, 


,56 


0.22 


2, 


.14 


30, 


,60 


a 


.03 


Moderate avg. 


172, 


.51 


55, 


,27 


3.88 


8, 


.98 


49, 


,11 


2.58 


8, 


.02 


45, 


,61 


L 




Large avg. 


261 


.72 


52, 


.85 


9.69 


234, 


.83 


47, 


.59 


5.12 


9, 


.51 


42. 


,66 


3, 


.25 
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Table A. 32: MAP metaheuristics comparison for large running times. 



Relative solution error, % 







10 sec. 




30 sec. 




100 sec. 




300 sec. 




Instance 


HL 


SA 


GK 


HL 


SA 


GK 


HL 


SA 


GK 


HL 


SA 


GK 


3r40 


38.25 


63.50 


4.50 


32.50 


60.75 


4.75 


28.75 


51.75 


2.50 


27.25 


47.00 


1.75 


3r70 


14.00 


55.00 


0.57 


13.29 


45.14 


0.00 


11.43 


37.71 


0.00 


10.71 


34.29 


0.00 


3rl00 


4.10 


45.60 


0.00 


3.50 


36.60 


0.00 


3.00 


30.80 


0.00 


2.40 


24.80 


0.00 


4r20 


49.50 


94.50 


0.00 


44.00 


80.00 


0.00 


38.50 


63.00 


0.00 


34.00 


52.00 


0.00 


4r30 


37.33 


83.00 


0.00 


33.67 


68.00 


0.00 


31.00 


58.00 


0.00 


28.00 


45.00 


0.00 


4r40 


27.00 


66.00 


0.00 


22.75 


62.25 


0.00 


20.25 


49.75 


0.00 


19.50 


41.75 


0.00 


5rl5 


42.67 


82.00 


0.00 


35.33 


75.33 


0.00 


32.00 


65.33 


0.00 


28.00 


51.33 


0.00 


5rl8 


47.22 


95.56 


0.00 


41.67 


71.11 


0.00 


31.67 


62.22 


0.00 


28.33 


59.44 


0.00 


5r25 


40.00 


90.00 


0.00 


32.00 


68.40 


0.00 


27.60 


61.20 


0.00 


24.40 


51.20 


0.00 


6rl2 


42.50 


91.67 


0.00 


33.33 


74.17 


0.00 


25.00 


60.83 


0.00 


16.67 


53.33 


0.00 


6rl5 


38.00 


90.00 


0.00 


34.00 


74.00 


0.00 


27.33 


64.00 


0.00 


26.00 


52.00 


0.00 


6rl8 


37.78 


95.00 


0.00 


33.89 


76.11 


0.00 


28.89 


72.22 


0.00 


23.89 


56.67 


0.00 


All avg. 


34.86 


79.32 


0.42 


29.99 


65.99 


0.40 


25.45 


56.40 


0.21 


22.43 


47.40 


0.15 


3-AP avg. 


18.78 


54.70 


1.69 


16.43 


47.50 


1.58 


14.39 


40.09 


0.83 


13.45 


35.36 


0.58 


4-AP avg. 


37.94 


81.17 


0.00 


33.47 


70.08 


0.00 


29.92 


56.92 


0.00 


27.17 


46.25 


0.00 


5-AP avg. 


43.30 


89.19 


0.00 


36.33 


71.61 


0.00 


30.42 


62.92 


0.00 


26.91 


53.99 


0.00 


6-AP avg. 


39.43 


92.22 


0.00 


33.74 


74.76 


0.00 


27.07 


65.69 


0.00 


22.19 


54.00 


0.00 


Small avg. 


43.23 


82.92 


1.13 


36.29 


72.56 


1.19 


31.06 


60.23 


0.63 


26.48 


50.92 


0.44 


Moderate avg. 


34.14 


80.89 


0.14 


30.65 


64.56 


0.00 


25.36 


55.48 


0.00 


23.26 


47.68 


0.00 


Large avg. 


27.22 


74.15 


0.00 


23.03 


60.84 


0.00 


19.93 


53.49 


0.00 


17.55 


43.60 


0.00 



3cq40 


2, 


.21 


7, 


.71 


IL 


.00 


1. 


,83 


6, 


.50 


0.00 


0.96 


4.29 


0.00 


0.91 


2.94 


0.00 


3sr40 


3, 


.16 


9, 


.61 


0, 


,11 


2. 


,41 


6, 


.63 


0.00 


1.82 


5.27 


0.00 


1.00 


3.10 


0.00 


3cq70 


10, 


.59 


25, 


.66 


3, 


.25 


9. 


,96 


22, 


.15 


1.49 


8.62 


17.36 


1.17 


8.07 


13.35 


0.70 


3sr70 


12, 


.87 


32, 


.42 




H 


12. 


17 


24, 


.37 


1.86 


10.50 


20.82 


1.18 


9.89 


17.23 


0.41 


3cql00 


14, 


.36 


40, 


.41 


7, 


,21 


13, 


,90 


33, 


.08 


5.49 


12.87 


27.63 


5.18 


11.51 


24.22 


4.71 


3srl00 


15, 


.34 


45, 


.72 




.27 


14, 


,03 


38, 


.22 


4.63 


13.22 


30.96 


3.30 


12.56 


27.57 


3.27 


4cq20 





.43 


6, 


.90 


0, 


,01 


0, 


,22 


3, 


.23 


0.00 


0.05 


2.80 


0.00 


0.01 


1.03 


0.00 


4sr20 


0, 


.91 


2, 


.04 




.03 


0, 


,69 


1, 


.54 


0.00 


0.48 


1.19 


0.00 


0.22 


0.40 


0.00 


4cq30 


4, 


.78 


14, 


.91 


a 


,18 


4, 


,03 


11, 


.24 


0.17 


3.03 


7.29 


0.14 


2.45 


4.63 


0.07 


4sr30 


13, 


.40 


22, 


.09 


L 


.01 


12. 


,24 


18, 


.87 


0.52 


10.60 


14.32 


0.28 


9.68 


11.19 


0.13 


4cq40 


9 


.43 


20, 


.53 


1, 


.02 


8. 


.92 


15, 


.90 


0.87 


8.40 


12.47 


0.39 


7.67 


7.79 


0.45 


4sr40 


13, 


.43 


17, 


.58 


1. 


.85 


11. 


,84 


14, 


.93 


1.30 


10.48 


12.03 


0.47 


10.14 


9.56 


0.41 


5cql5 





.06 


28, 


.03 


0; 


.00 


0. 


.03 


27, 


.55 


0.00 


0.03 


27.14 


0.00 


0.00 


26.99 


0.00 


5srl5 





.56 


29, 


.75 


0. 


.00 


0. 


,19 


29, 


.66 


0.00 


0.00 


29.66 


0.00 


0.00 


29.66 


0.00 


5cql8 





.78 


34, 


.26 


0; 


.04 


0. 


,38 


33, 


.27 


0.02 


0.03 


32.75 


0.00 


0.00 


32.44 


0.00 


5srl8 


10, 


.24 


126, 


.20 


0. 


.06 


8. 


.81 


124, 


.74 


0.00 


7.09 


123.65 


0.00 


6.28 


123.09 


0.00 


5cq25 


3 


.95 


42, 


.39 


0. 


.10 


3. 


,35 


41, 


.83 


0.03 


2.53 


39.92 


0.07 


2.27 


39.36 


0.06 


5sr25 


6, 


.21 


43, 


.15 


(L 


.64 


5, 


,85 


42, 


.13 


0.31 


5.16 


41.85 


0.10 


4.37 


41.70 


0.14 


6cql2 


0, 


.00 


34, 


.69 


0, 


.00 


0, 


,00 


34, 


.71 


0.00 


0.00 


34.00 


0.00 


0.00 


33.93 


0.00 



6srl2 4.16 109.43 OOO 3.66 109.41 OOQ 2.11 109.41 (WO 1.59 109.41 Om 

6cql5 0.76 41.57 006 0.39 41.39 OOQ 0.07 41.11 OOQ 0.03 40.80 OOQ 

6srl5 1.29 39.57 0^ 0.93 39.57 OW 0.70 39.57 OOO 0.60 39.57 OOQ 

6cql8 1.39 47.49 026 1.06 47.27 0A5 0.64 46.90 O08 0.43 46.78 O06 

6srl8 3.31 47.23 0.25 2.79 47.15 0.03 2.14 47.14 0.04 1.74 47.14 0.04 



All avg. 


5. 


,57 


36, 


.22 


L 


.07 


4. 


.99 


33, 


.97 


O 


.71 


4. 


.23 


32, 


.06 


a 


.52 


3. 


.81 


30, 


.58 


a 


,44 


Clique avg. 


4. 


,06 


28, 


.72 


L 


.01 


3. 


,67 


26, 


.51 




.69 


3. 


,10 


24, 


.47 




.59 


2. 


,78 


22, 


.85 




.50 


SR avg. 


7. 


,07 


43, 


.73 


L 


13 


6. 


,30 


41, 


.43 


o 


73 


5. 


,36 


39, 


.66 





.45 


4. 


,84 


38, 


.30 





,37 


3-AP avg. 


9, 


,76 


26, 


.93 


3, 


,33 


9, 


,05 


21, 


.83 


2, 


,25 


8, 


,00 


17, 


.72 


1, 


.80 


7, 


,32 


14, 


.73 


1, 


.51 


4-AP avg. 


7, 


,06 


14, 


.01 


0, 


.§8 


6, 


,32 


10, 


.95 


0, 


,48 


5, 


,51 


8, 


.35 


0, 


.21 


5, 


,03 


5, 


.77 


0, 


.18 


5-AP avg. 


3, 


,64 


50, 


.63 


(L 


M 


3, 


10 


49, 


.86 


(L 


.06 


2, 


,47 


49, 


.16 




.03 


2, 


15 


48, 


.87 




,03 


6-AP avg. 


1, 


,82 


53, 


.33 





.13 


1, 


,47 


53, 


.25 





.05 


0, 


,94 


53, 


.02 





.02 


0, 


,73 


52, 


.94 





.02 


Small avg. 


1, 


,44 


28, 


.52 


0, 


.02 


1, 


13 


27, 


.40 


0, 


.00 


0, 


,68 


26, 


.72 


0, 


.00 


0, 


,47 


25, 


.93 


0, 


.00 


Moderate avg. 


6, 


,84 


42, 


.09 


(L 


.99 


6, 


11 


39, 


.45 


(L 


.52 


5, 


,08 


37, 


.11 




.35 


4, 


,62 


35, 


.29 




.16 


Large avg. 


8, 


,43 


38, 


.06 


2, 


.20 


7. 


,72 


35, 


.06 


L 


.60 


6. 


,93 


32, 


.36 




.20 


6. 


,34 


30, 


.51 


i 


.14 



